May 28 14:52:31.899633 ip-10-0-131-234 systemd[1]: Starting Kubernetes Kubelet... May 28 14:52:32.409127 ip-10-0-131-234 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 14:52:32.409127 ip-10-0-131-234 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 14:52:32.409127 ip-10-0-131-234 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 14:52:32.409127 ip-10-0-131-234 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 14:52:32.409127 ip-10-0-131-234 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 14:52:32.411069 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.410979 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 14:52:32.417637 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417614 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 14:52:32.417637 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417631 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 14:52:32.417637 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417636 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 14:52:32.417637 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417640 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417645 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417651 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417654 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417658 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417661 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417665 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417669 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417673 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417677 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417681 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417684 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417689 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417692 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417696 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417700 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417703 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417707 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417711 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 14:52:32.417882 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417715 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417718 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417722 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417726 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417730 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417734 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417738 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417742 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417746 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417750 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417754 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417758 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417762 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417766 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417771 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417777 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417781 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417785 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417791 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417797 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 14:52:32.418657 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417802 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417806 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417810 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417814 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417818 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417823 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417827 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417831 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417836 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417842 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417849 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417855 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417862 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417869 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417874 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417879 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417883 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417887 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417892 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 14:52:32.419552 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417896 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417909 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417914 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417918 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417922 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417928 2555 feature_gate.go:328] unrecognized feature gate: Example May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417932 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417937 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417942 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417946 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417950 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417955 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417960 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417964 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417968 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417973 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417977 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417981 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417985 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417989 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 14:52:32.420369 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417994 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.417998 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418002 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418006 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418010 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418698 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418709 2555 feature_gate.go:328] unrecognized feature gate: Example May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418714 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418718 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418724 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418729 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418733 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418737 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418742 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418746 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418752 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418758 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418764 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418769 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418773 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 14:52:32.421027 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418778 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418782 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418787 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418791 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418795 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418798 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418803 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418807 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418812 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418816 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418820 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418823 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418828 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418832 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418836 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418840 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418844 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418848 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418853 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418857 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 14:52:32.421731 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418861 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418865 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418870 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418874 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418879 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418883 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418887 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418892 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418896 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418900 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418906 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418910 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418914 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418918 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418923 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418927 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418931 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418935 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418940 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418944 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 14:52:32.422287 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418948 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418963 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418968 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418973 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418977 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418981 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418986 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418990 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418994 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.418998 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419002 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419007 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419011 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419015 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419022 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419027 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419031 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419035 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419040 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 14:52:32.422814 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419044 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419048 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419052 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419057 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419062 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419072 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419076 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419081 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419087 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419091 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419095 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.419100 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419194 2555 flags.go:64] FLAG: --address="0.0.0.0" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419205 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419216 2555 flags.go:64] FLAG: --anonymous-auth="true" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419223 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419229 2555 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419235 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419241 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419248 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419253 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 14:52:32.423378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419258 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419263 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419269 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419274 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419279 2555 flags.go:64] FLAG: --cgroup-root="" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419283 2555 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419288 2555 flags.go:64] FLAG: --client-ca-file="" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419293 2555 flags.go:64] FLAG: --cloud-config="" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419298 2555 flags.go:64] FLAG: --cloud-provider="external" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419303 2555 flags.go:64] FLAG: --cluster-dns="[]" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419324 2555 flags.go:64] FLAG: --cluster-domain="" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419330 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419335 2555 flags.go:64] FLAG: --config-dir="" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419340 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419346 2555 flags.go:64] FLAG: --container-log-max-files="5" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419352 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419362 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419367 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419372 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419377 2555 flags.go:64] FLAG: --contention-profiling="false" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419382 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419387 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419392 2555 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419397 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419404 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 14:52:32.423881 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419409 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419413 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419418 2555 flags.go:64] FLAG: --enable-load-reader="false" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419423 2555 flags.go:64] FLAG: --enable-server="true" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419428 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419435 2555 flags.go:64] FLAG: --event-burst="100" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419441 2555 flags.go:64] FLAG: --event-qps="50" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419446 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419451 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419456 2555 flags.go:64] FLAG: --eviction-hard="" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419462 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419467 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419471 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419477 2555 flags.go:64] FLAG: --eviction-soft="" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419481 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419486 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419491 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419496 2555 flags.go:64] FLAG: --experimental-mounter-path="" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419501 2555 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419506 2555 flags.go:64] FLAG: --fail-swap-on="true" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419511 2555 flags.go:64] FLAG: --feature-gates="" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419518 2555 flags.go:64] FLAG: --file-check-frequency="20s" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419523 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419530 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419536 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419541 2555 flags.go:64] FLAG: --healthz-port="10248" May 28 14:52:32.424538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419546 2555 flags.go:64] FLAG: --help="false" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419551 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-131-234.ec2.internal" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419556 2555 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419561 2555 flags.go:64] FLAG: --http-check-frequency="20s" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419566 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419571 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419577 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419581 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419586 2555 flags.go:64] FLAG: --image-service-endpoint="" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419592 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419597 2555 flags.go:64] FLAG: --kube-api-burst="100" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419602 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419607 2555 flags.go:64] FLAG: --kube-api-qps="50" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419612 2555 flags.go:64] FLAG: --kube-reserved="" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419617 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419622 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419627 2555 flags.go:64] FLAG: --kubelet-cgroups="" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419632 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419637 2555 flags.go:64] FLAG: --lock-file="" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419642 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419647 2555 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419652 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419666 2555 flags.go:64] FLAG: --log-json-split-stream="false" May 28 14:52:32.425153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419672 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419677 2555 flags.go:64] FLAG: --log-text-split-stream="false" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419681 2555 flags.go:64] FLAG: --logging-format="text" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419686 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419692 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419697 2555 flags.go:64] FLAG: --manifest-url="" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419703 2555 flags.go:64] FLAG: --manifest-url-header="" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419711 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419717 2555 flags.go:64] FLAG: --max-open-files="1000000" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419724 2555 flags.go:64] FLAG: --max-pods="110" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419729 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419734 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419738 2555 flags.go:64] FLAG: --memory-manager-policy="None" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419743 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419748 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419753 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419758 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419770 2555 flags.go:64] FLAG: --node-status-max-images="50" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419775 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419780 2555 flags.go:64] FLAG: --oom-score-adj="-999" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419785 2555 flags.go:64] FLAG: --pod-cidr="" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419790 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419799 2555 flags.go:64] FLAG: --pod-manifest-path="" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419804 2555 flags.go:64] FLAG: --pod-max-pids="-1" May 28 14:52:32.425750 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419809 2555 flags.go:64] FLAG: --pods-per-core="0" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419814 2555 flags.go:64] FLAG: --port="10250" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419819 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419824 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028a281412f40b617" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419829 2555 flags.go:64] FLAG: --qos-reserved="" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419835 2555 flags.go:64] FLAG: --read-only-port="10255" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419839 2555 flags.go:64] FLAG: --register-node="true" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419844 2555 flags.go:64] FLAG: --register-schedulable="true" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419851 2555 flags.go:64] FLAG: --register-with-taints="" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419857 2555 flags.go:64] FLAG: --registry-burst="10" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419862 2555 flags.go:64] FLAG: --registry-qps="5" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419866 2555 flags.go:64] FLAG: --reserved-cpus="" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419871 2555 flags.go:64] FLAG: --reserved-memory="" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419877 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419884 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419889 2555 flags.go:64] FLAG: --rotate-certificates="false" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419894 2555 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419900 2555 flags.go:64] FLAG: --runonce="false" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419905 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419910 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419915 2555 flags.go:64] FLAG: --seccomp-default="false" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419920 2555 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419925 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419930 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419935 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419940 2555 flags.go:64] FLAG: --storage-driver-password="root" May 28 14:52:32.426399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419945 2555 flags.go:64] FLAG: --storage-driver-secure="false" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419950 2555 flags.go:64] FLAG: --storage-driver-table="stats" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419954 2555 flags.go:64] FLAG: --storage-driver-user="root" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419959 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419964 2555 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419969 2555 flags.go:64] FLAG: --system-cgroups="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419974 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419982 2555 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419987 2555 flags.go:64] FLAG: --tls-cert-file="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419992 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.419998 2555 flags.go:64] FLAG: --tls-min-version="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420003 2555 flags.go:64] FLAG: --tls-private-key-file="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420008 2555 flags.go:64] FLAG: --topology-manager-policy="none" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420013 2555 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420021 2555 flags.go:64] FLAG: --topology-manager-scope="container" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420027 2555 flags.go:64] FLAG: --v="2" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420034 2555 flags.go:64] FLAG: --version="false" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420040 2555 flags.go:64] FLAG: --vmodule="" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420047 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420052 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420205 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420211 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420216 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420222 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 14:52:32.427038 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420226 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420231 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420235 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420240 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420244 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420248 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420252 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420256 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420261 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420265 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420270 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420274 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420278 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420283 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420287 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420291 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420296 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420300 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420304 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 14:52:32.427891 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420324 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420331 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420337 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420344 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420348 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420352 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420357 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420361 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420365 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420371 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420375 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420379 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420383 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420387 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420393 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420397 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420402 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420407 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420412 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420416 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 14:52:32.428476 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420420 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420424 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420428 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420433 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420437 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420442 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420446 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420450 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420455 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420459 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420464 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420468 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420473 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420477 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420481 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420488 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420492 2555 feature_gate.go:328] unrecognized feature gate: Example May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420496 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420500 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420505 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 14:52:32.428969 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420509 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420514 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420519 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420523 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420528 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420532 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420536 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420542 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420547 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420551 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420555 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420562 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420568 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420573 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420578 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420582 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420588 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420592 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420598 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 14:52:32.429464 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420602 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420607 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420611 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.420616 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.420624 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.428478 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.428495 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428543 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428548 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428552 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428555 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428558 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428561 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428564 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428567 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428570 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 14:52:32.429972 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428572 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428575 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428578 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428582 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428585 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428587 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428590 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428593 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428595 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428598 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428601 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428603 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428607 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428610 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428612 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428615 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428618 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428620 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428623 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 14:52:32.430385 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428625 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428628 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428631 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428634 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428636 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428639 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428642 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428646 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428651 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428654 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428657 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428660 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428662 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428665 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428667 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428670 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428673 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428675 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428678 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428681 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 28 14:52:32.430842 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428683 2555 feature_gate.go:328] unrecognized feature gate: Example May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428686 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428689 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428692 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428694 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428697 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428699 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428702 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428705 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428707 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428710 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428712 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428715 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428718 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428720 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428724 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428726 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428729 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428732 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428735 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 14:52:32.431380 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428738 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428740 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428743 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428745 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428748 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428751 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428753 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428756 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428760 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428763 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428766 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428768 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428771 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428774 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428776 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428779 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428783 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 14:52:32.431873 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428787 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.428792 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428905 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428911 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428914 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428917 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428921 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428925 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428928 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428930 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428933 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428936 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428939 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428942 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428945 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 14:52:32.432283 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428947 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428950 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428953 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428956 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428958 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428961 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428963 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428966 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428968 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428972 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428975 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428978 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428981 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428984 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428986 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428989 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428992 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428994 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.428997 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429000 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 14:52:32.432676 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429003 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429005 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429008 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429010 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429013 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429015 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429018 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429021 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429024 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429027 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429029 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429032 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429035 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429037 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429040 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429042 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429044 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429047 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429050 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429052 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 14:52:32.433158 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429055 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429058 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429060 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429063 2555 feature_gate.go:328] unrecognized feature gate: Example May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429066 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429069 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429071 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429074 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429076 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429079 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429082 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429084 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429087 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429090 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429092 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429096 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429100 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429103 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429106 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429109 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 14:52:32.433677 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429112 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429114 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429117 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429120 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429122 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429125 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429128 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429130 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429133 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429135 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429138 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429141 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:32.429143 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.429147 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.429898 2555 server.go:962] "Client rotation is on, will bootstrap in background" May 28 14:52:32.434146 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.432057 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 14:52:32.434557 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.433026 2555 server.go:1019] "Starting client certificate rotation" May 28 14:52:32.434557 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.433123 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 14:52:32.434557 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.433160 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 14:52:32.465591 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.465571 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 14:52:32.469479 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.469464 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 14:52:32.484693 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.484672 2555 log.go:25] "Validated CRI v1 runtime API" May 28 14:52:32.490305 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.490290 2555 log.go:25] "Validated CRI v1 image API" May 28 14:52:32.493538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.493522 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 14:52:32.496119 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.495916 2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b7e45ecd-5347-4bde-bf35-1ad11ba42a50:/dev/nvme0n1p3 b8a566d4-4d03-418c-af90-7521fc83dc5c:/dev/nvme0n1p4] May 28 14:52:32.496119 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.495935 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 14:52:32.498542 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.498342 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 14:52:32.501240 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.501138 2555 manager.go:217] Machine: {Timestamp:2026-05-28 14:52:32.500659972 +0000 UTC m=+0.467421727 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099169 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27a049d8c5fb001eeabb4dfb5096ac SystemUUID:ec27a049-d8c5-fb00-1eea-bb4dfb5096ac BootID:a6df6cbe-fc1a-4898-ab46-534cfb408969 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:d5:d8:5d:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:d5:d8:5d:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:b7:c4:cc:ea:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 14:52:32.501240 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.501236 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 14:52:32.501384 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.501328 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 14:52:32.503896 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.503871 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 14:52:32.504026 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.503900 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 14:52:32.504612 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.504602 2555 topology_manager.go:138] "Creating topology manager with none policy" May 28 14:52:32.504648 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.504614 2555 container_manager_linux.go:306] "Creating device plugin manager" May 28 14:52:32.504648 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.504621 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 14:52:32.505397 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.505386 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 14:52:32.507604 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.507593 2555 state_mem.go:36] "Initialized new in-memory state store" May 28 14:52:32.507718 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.507709 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 14:52:32.510125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.510115 2555 kubelet.go:491] "Attempting to sync node with API server" May 28 14:52:32.510161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.510129 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 14:52:32.510161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.510140 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 14:52:32.510161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.510149 2555 kubelet.go:397] "Adding apiserver pod source" May 28 14:52:32.510161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.510157 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 14:52:32.511406 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.511390 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 14:52:32.511494 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.511411 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 14:52:32.514650 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.514635 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 14:52:32.516752 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.516739 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 14:52:32.517501 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517485 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 14:52:32.517501 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517503 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517510 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517516 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517524 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517530 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517535 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517540 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517546 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517552 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 14:52:32.517617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517567 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 14:52:32.517950 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.517939 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 14:52:32.518791 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.518780 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 14:52:32.518828 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.518793 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 14:52:32.521916 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.521901 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 14:52:32.521986 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.521938 2555 server.go:1295] "Started kubelet" May 28 14:52:32.522563 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.522511 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 14:52:32.522634 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.522584 2555 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 14:52:32.522733 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.522691 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 14:52:32.522818 ip-10-0-131-234 systemd[1]: Started Kubernetes Kubelet. May 28 14:52:32.523630 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.523606 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 14:52:32.523720 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.523669 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 14:52:32.523720 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.523679 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 14:52:32.525560 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.525543 2555 server.go:317] "Adding debug handlers to kubelet server" May 28 14:52:32.526136 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.526116 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 14:52:32.529476 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.528465 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-234.ec2.internal.18b3c2560962a63e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-234.ec2.internal,UID:ip-10-0-131-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-234.ec2.internal,},FirstTimestamp:2026-05-28 14:52:32.521913918 +0000 UTC m=+0.488675674,LastTimestamp:2026-05-28 14:52:32.521913918 +0000 UTC m=+0.488675674,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-234.ec2.internal,}" May 28 14:52:32.530416 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.530397 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 14:52:32.532356 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532344 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 14:52:32.532428 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532359 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 14:52:32.532428 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532413 2555 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 14:52:32.532428 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532425 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 14:52:32.532565 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532509 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 14:52:32.532565 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532545 2555 reconstruct.go:97] "Volume reconstruction finished" May 28 14:52:32.532565 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.532553 2555 reconciler.go:26] "Reconciler: start to sync state" May 28 14:52:32.533269 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.533232 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:32.534494 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.534460 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 14:52:32.535253 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535235 2555 factory.go:55] Registering systemd factory May 28 14:52:32.535447 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535429 2555 factory.go:223] Registration of the systemd container factory successfully May 28 14:52:32.535732 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535689 2555 factory.go:153] Registering CRI-O factory May 28 14:52:32.535732 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535710 2555 factory.go:223] Registration of the crio container factory successfully May 28 14:52:32.535921 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535782 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 14:52:32.535921 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535800 2555 factory.go:103] Registering Raw factory May 28 14:52:32.535921 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.535816 2555 manager.go:1196] Started watching for new ooms in manager May 28 14:52:32.536328 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.536292 2555 manager.go:319] Starting recovery of all containers May 28 14:52:32.543748 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.543723 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 28 14:52:32.546963 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.546849 2555 manager.go:324] Recovery completed May 28 14:52:32.550836 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.550823 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 14:52:32.552473 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.552456 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientMemory" May 28 14:52:32.552545 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.552492 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasNoDiskPressure" May 28 14:52:32.552545 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.552507 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientPID" May 28 14:52:32.553019 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.553003 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 14:52:32.553019 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.553019 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 14:52:32.553119 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.553034 2555 state_mem.go:36] "Initialized new in-memory state store" May 28 14:52:32.553247 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.553229 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vsglj" May 28 14:52:32.556474 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.556463 2555 policy_none.go:49] "None policy: Start" May 28 14:52:32.556521 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.556479 2555 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 14:52:32.556521 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.556489 2555 state_mem.go:35] "Initializing new in-memory state store" May 28 14:52:32.560417 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.560398 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vsglj" May 28 14:52:32.562910 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.562845 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-234.ec2.internal.18b3c2560b34eec5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-234.ec2.internal,UID:ip-10-0-131-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-234.ec2.internal,},FirstTimestamp:2026-05-28 14:52:32.552472261 +0000 UTC m=+0.519234023,LastTimestamp:2026-05-28 14:52:32.552472261 +0000 UTC m=+0.519234023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-234.ec2.internal,}" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597459 2555 manager.go:341] "Starting Device Plugin manager" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.597487 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597500 2555 server.go:85] "Starting device plugin registration server" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597750 2555 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597762 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597846 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597925 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.597934 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.598505 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 14:52:32.613370 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.598537 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:32.633208 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.633181 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 14:52:32.634408 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.634392 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 14:52:32.634514 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.634413 2555 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 14:52:32.634514 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.634431 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 14:52:32.634514 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.634438 2555 kubelet.go:2451] "Starting kubelet main sync loop" May 28 14:52:32.634514 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.634475 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 14:52:32.640125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.640108 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 14:52:32.698833 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.698769 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 14:52:32.699741 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.699726 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientMemory" May 28 14:52:32.699817 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.699755 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasNoDiskPressure" May 28 14:52:32.699817 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.699772 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientPID" May 28 14:52:32.699817 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.699800 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-234.ec2.internal" May 28 14:52:32.706550 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.706533 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-234.ec2.internal" May 28 14:52:32.706604 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.706556 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-234.ec2.internal\": node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:32.723562 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.723539 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:32.735529 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.735495 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal"] May 28 14:52:32.735590 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.735575 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 14:52:32.736382 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.736370 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientMemory" May 28 14:52:32.736429 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.736398 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasNoDiskPressure" May 28 14:52:32.736429 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.736411 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientPID" May 28 14:52:32.737541 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.737529 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 14:52:32.737711 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.737695 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:32.737774 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.737724 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 14:52:32.738207 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.738189 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientMemory" May 28 14:52:32.738207 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.738200 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientMemory" May 28 14:52:32.738301 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.738221 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasNoDiskPressure" May 28 14:52:32.738301 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.738234 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientPID" May 28 14:52:32.738382 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.738222 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasNoDiskPressure" May 28 14:52:32.738382 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.738344 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientPID" May 28 14:52:32.739371 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.739357 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" May 28 14:52:32.739430 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.739380 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 14:52:32.739991 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.739976 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientMemory" May 28 14:52:32.740046 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.740002 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasNoDiskPressure" May 28 14:52:32.740046 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.740015 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeHasSufficientPID" May 28 14:52:32.768840 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.768818 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-234.ec2.internal\" not found" node="ip-10-0-131-234.ec2.internal" May 28 14:52:32.772982 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.772967 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-234.ec2.internal\" not found" node="ip-10-0-131-234.ec2.internal" May 28 14:52:32.823662 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.823640 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:32.923936 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:32.923913 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:32.933161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.933140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5f247a02cd64a7699e96f1ae12f62c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal\" (UID: \"d5f247a02cd64a7699e96f1ae12f62c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:32.933232 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.933167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5f247a02cd64a7699e96f1ae12f62c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal\" (UID: \"d5f247a02cd64a7699e96f1ae12f62c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:32.933232 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:32.933187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6ff3f21836bc88daa29afcf104c5cc9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-234.ec2.internal\" (UID: \"b6ff3f21836bc88daa29afcf104c5cc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" May 28 14:52:33.024555 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.024498 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.033724 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.033704 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5f247a02cd64a7699e96f1ae12f62c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal\" (UID: \"d5f247a02cd64a7699e96f1ae12f62c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:33.033787 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.033731 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5f247a02cd64a7699e96f1ae12f62c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal\" (UID: \"d5f247a02cd64a7699e96f1ae12f62c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:33.033787 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.033748 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6ff3f21836bc88daa29afcf104c5cc9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-234.ec2.internal\" (UID: \"b6ff3f21836bc88daa29afcf104c5cc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" May 28 14:52:33.033879 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.033786 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6ff3f21836bc88daa29afcf104c5cc9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-234.ec2.internal\" (UID: \"b6ff3f21836bc88daa29afcf104c5cc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" May 28 14:52:33.033879 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.033802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5f247a02cd64a7699e96f1ae12f62c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal\" (UID: \"d5f247a02cd64a7699e96f1ae12f62c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:33.033879 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.033825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5f247a02cd64a7699e96f1ae12f62c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal\" (UID: \"d5f247a02cd64a7699e96f1ae12f62c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:33.071850 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.071817 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:33.075605 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.075582 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" May 28 14:52:33.125220 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.125193 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.225650 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.225618 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.326151 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.326089 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.426604 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.426574 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.432739 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.432716 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 14:52:33.432863 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.432847 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 14:52:33.473532 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.473509 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 14:52:33.527244 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.527227 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.532723 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.532697 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 14:52:33.543941 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.543919 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 14:52:33.562780 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.562746 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 14:47:32 +0000 UTC" deadline="2028-01-23 19:58:14.488134673 +0000 UTC" May 28 14:52:33.562872 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.562783 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14525h5m40.92535458s" May 28 14:52:33.592030 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.591985 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-72mdp" May 28 14:52:33.602124 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.602109 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-72mdp" May 28 14:52:33.628115 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.628095 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.662321 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:33.662280 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ff3f21836bc88daa29afcf104c5cc9.slice/crio-261e169fb52961caab6a9dd311feee58a7f2c6c3fffa8cdfbfc5d57354dba6ad WatchSource:0}: Error finding container 261e169fb52961caab6a9dd311feee58a7f2c6c3fffa8cdfbfc5d57354dba6ad: Status 404 returned error can't find the container with id 261e169fb52961caab6a9dd311feee58a7f2c6c3fffa8cdfbfc5d57354dba6ad May 28 14:52:33.662530 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:33.662510 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f247a02cd64a7699e96f1ae12f62c6.slice/crio-d5aeb01f744ed9d918646f1c7f0837517ab56fc76c6ab94504daf1e044eeaa75 WatchSource:0}: Error finding container d5aeb01f744ed9d918646f1c7f0837517ab56fc76c6ab94504daf1e044eeaa75: Status 404 returned error can't find the container with id d5aeb01f744ed9d918646f1c7f0837517ab56fc76c6ab94504daf1e044eeaa75 May 28 14:52:33.667187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.667171 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 14:52:33.728721 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.728698 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.829139 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.829108 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:33.831130 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:33.831111 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 14:52:33.929686 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:33.929602 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:34.030390 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.030357 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-234.ec2.internal\" not found" May 28 14:52:34.086894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.086742 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 14:52:34.133368 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.133340 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" May 28 14:52:34.147505 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.147477 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 14:52:34.148733 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.148713 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" May 28 14:52:34.154713 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.154695 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 14:52:34.511457 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.511424 2555 apiserver.go:52] "Watching apiserver" May 28 14:52:34.519925 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.519735 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 14:52:34.520195 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.520172 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87","openshift-cluster-node-tuning-operator/tuned-m9zb5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-tm9sx","openshift-multus/network-metrics-daemon-qbj7c","openshift-ovn-kubernetes/ovnkube-node-6n5w8","openshift-dns/node-resolver-9xjw2","openshift-image-registry/node-ca-98jws","openshift-multus/multus-vn94b","openshift-network-diagnostics/network-check-target-wrsft","openshift-network-operator/iptables-alerter-9qrhs","kube-system/konnectivity-agent-dxv6d","kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal"] May 28 14:52:34.525028 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.524933 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:34.525141 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.525026 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.525141 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.525043 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:34.527469 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.527437 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.527989 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.527908 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fclhj\"" May 28 14:52:34.530333 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.528350 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 14:52:34.530333 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.528598 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 14:52:34.530333 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.530212 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 14:52:34.530797 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.530772 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 14:52:34.530797 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.530787 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 14:52:34.531044 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.531028 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 14:52:34.531112 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.531042 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 14:52:34.531112 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.531096 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5dgjk\"" May 28 14:52:34.532656 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.532622 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:34.532752 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.532692 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:34.532809 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.532784 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.535109 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.535097 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmpkl\"" May 28 14:52:34.535182 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.535114 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 14:52:34.535391 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.535376 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 14:52:34.535720 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.535705 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.536281 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.536264 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 14:52:34.536390 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.536300 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 14:52:34.536390 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.536335 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 14:52:34.536390 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.536264 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 14:52:34.538233 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.537829 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sntc6\"" May 28 14:52:34.538233 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.537895 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vn94b" May 28 14:52:34.538233 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.538157 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 14:52:34.538233 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.538182 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 14:52:34.538233 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.538194 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 14:52:34.539855 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.539839 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 14:52:34.540237 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.540219 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.540337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.540299 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ckfpl\"" May 28 14:52:34.541437 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:34.541537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541452 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-kubelet\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-ovn\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovn-node-metrics-cert\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b178de4-ff32-4f71-ace9-fd0ae3e26280-host\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.541743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b178de4-ff32-4f71-ace9-fd0ae3e26280-serviceca\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.541743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:34.541743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541614 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-modprobe-d\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.541743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541666 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-host\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.541743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-tmp\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.541743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541726 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cnibin\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-systemd-units\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-var-lib-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-lib-modules\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmdcs\" (UniqueName: \"kubernetes.io/projected/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-kube-api-access-wmdcs\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541908 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-run-netns\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.541971 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-etc-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.541972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-cni-bin\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovnkube-script-lib\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542076 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwnp4\" (UniqueName: \"kubernetes.io/projected/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-kube-api-access-cwnp4\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-kubernetes\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-sys\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542172 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-slash\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542248 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542228 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovnkube-config\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542294 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysctl-conf\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-node-log\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-log-socket\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysconfig\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542465 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysctl-d\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542472 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kvhvp\"" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-var-lib-kubelet\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-os-release\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542582 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542585 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.542633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-systemd\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-systemd\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542684 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542693 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-run\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542726 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz4r9\" (UniqueName: \"kubernetes.io/projected/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-kube-api-access-vz4r9\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6xxt\" (UniqueName: \"kubernetes.io/projected/966e40a6-12aa-4008-af5e-79ad1884aa83-kube-api-access-f6xxt\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542866 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-cni-netd\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-env-overrides\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhzm\" (UniqueName: \"kubernetes.io/projected/7b178de4-ff32-4f71-ace9-fd0ae3e26280-kube-api-access-pmhzm\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-tuned\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.543187 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.542964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-system-cni-dir\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.544941 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.544920 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.545420 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.544823 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.547305 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.547286 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.547401 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.547331 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2xvbn\"" May 28 14:52:34.547630 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.547614 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 14:52:34.547794 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.547775 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 14:52:34.547857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.547821 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 14:52:34.548273 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.548256 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngv78\"" May 28 14:52:34.548580 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.548256 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 14:52:34.548580 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.548343 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 14:52:34.549557 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.549538 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 14:52:34.549733 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.549648 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bd8vs\"" May 28 14:52:34.550032 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.550015 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 14:52:34.602678 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.602652 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 14:47:33 +0000 UTC" deadline="2028-02-04 06:43:56.374998062 +0000 UTC" May 28 14:52:34.602678 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.602677 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14799h51m21.772324265s" May 28 14:52:34.633360 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.633333 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 14:52:34.638958 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.638903 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" event={"ID":"d5f247a02cd64a7699e96f1ae12f62c6","Type":"ContainerStarted","Data":"d5aeb01f744ed9d918646f1c7f0837517ab56fc76c6ab94504daf1e044eeaa75"} May 28 14:52:34.640208 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.640179 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" event={"ID":"b6ff3f21836bc88daa29afcf104c5cc9","Type":"ContainerStarted","Data":"261e169fb52961caab6a9dd311feee58a7f2c6c3fffa8cdfbfc5d57354dba6ad"} May 28 14:52:34.643693 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643668 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-system-cni-dir\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.643798 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643704 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:34.643798 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-conf-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.643798 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643758 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-modprobe-d\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.643932 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643851 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-tmp\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.643932 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.643875 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:34.643932 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643886 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-systemd-units\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644061 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643934 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-systemd-units\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644061 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643939 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-system-cni-dir\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.644061 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.643964 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:35.143930456 +0000 UTC m=+3.110692219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:34.644061 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.643993 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-var-lib-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644061 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644022 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644061 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644055 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-var-lib-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-netns\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-modprobe-d\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfv7m\" (UniqueName: \"kubernetes.io/projected/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-kube-api-access-vfv7m\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644128 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/362fcd77-1677-4840-830d-b27bf923a874-hosts-file\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644199 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644204 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-run-netns\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644256 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-registration-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644260 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-run-netns\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0575fb3f-7adb-4c61-b3e9-37271e730c0b-konnectivity-ca\") pod \"konnectivity-agent-dxv6d\" (UID: \"0575fb3f-7adb-4c61-b3e9-37271e730c0b\") " pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644344 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-kubernetes\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644370 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-sys\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644402 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644394 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-slash\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644418 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644438 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644460 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-node-log\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644472 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-kubernetes\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644488 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-os-release\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644510 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysconfig\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644519 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-slash\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644526 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-var-lib-kubelet\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644527 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-sys\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644588 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-os-release\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644614 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysconfig\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-var-lib-kubelet\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-node-log\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644680 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-systemd\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.644944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644699 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-systemd\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6h98\" (UniqueName: \"kubernetes.io/projected/e4f3e90c-c42e-44f8-a18b-786af0495f30-kube-api-access-j6h98\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-os-release\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-multus-certs\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644805 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-run\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644850 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-run\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-hostroot\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/362fcd77-1677-4840-830d-b27bf923a874-tmp-dir\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644933 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644964 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.644985 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vz4r9\" (UniqueName: \"kubernetes.io/projected/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-kube-api-access-vz4r9\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645012 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6xxt\" (UniqueName: \"kubernetes.io/projected/966e40a6-12aa-4008-af5e-79ad1884aa83-kube-api-access-f6xxt\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-env-overrides\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645078 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhzm\" (UniqueName: \"kubernetes.io/projected/7b178de4-ff32-4f71-ace9-fd0ae3e26280-kube-api-access-pmhzm\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-system-cni-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.645510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-daemon-config\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-socket-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-etc-selinux\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645198 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-tuned\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645213 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-kubelet\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645231 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-ovn\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645253 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovn-node-metrics-cert\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645271 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b178de4-ff32-4f71-ace9-fd0ae3e26280-host\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645287 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b178de4-ff32-4f71-ace9-fd0ae3e26280-serviceca\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645324 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645344 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-host\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645359 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cnibin\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645374 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovnkube-script-lib\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645390 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-cni-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-socket-dir-parent\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-etc-kubernetes\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2dlb\" (UniqueName: \"kubernetes.io/projected/362fcd77-1677-4840-830d-b27bf923a874-kube-api-access-p2dlb\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.646060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645492 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-lib-modules\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645531 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmdcs\" (UniqueName: \"kubernetes.io/projected/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-kube-api-access-wmdcs\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645563 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-etc-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645589 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-cni-bin\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-env-overrides\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645616 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwnp4\" (UniqueName: \"kubernetes.io/projected/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-kube-api-access-cwnp4\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-lib-modules\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645888 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-etc-openvswitch\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645893 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-host\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.645927 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cnibin\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646015 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-cni-bin\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646068 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-kubelet\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646101 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b178de4-ff32-4f71-ace9-fd0ae3e26280-host\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-run-ovn\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7kp\" (UniqueName: \"kubernetes.io/projected/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-kube-api-access-fn7kp\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-cni-binary-copy\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.646561 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646343 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovnkube-config\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-kubelet\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646404 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysctl-conf\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646461 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-log-socket\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-device-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646520 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-sys-fs\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646536 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovnkube-script-lib\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646556 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b178de4-ff32-4f71-ace9-fd0ae3e26280-serviceca\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0575fb3f-7adb-4c61-b3e9-37271e730c0b-agent-certs\") pod \"konnectivity-agent-dxv6d\" (UID: \"0575fb3f-7adb-4c61-b3e9-37271e730c0b\") " pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-cnibin\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646626 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-log-socket\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-cni-multus\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646651 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysctl-conf\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646673 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysctl-d\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646699 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-iptables-alerter-script\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-k8s-cni-cncf-io\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.647199 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646801 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-systemd\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646829 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-sysctl-d\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovnkube-config\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646860 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-cni-netd\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-host-cni-netd\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646926 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-systemd\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646938 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-host-slash\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.646989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-cni-bin\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.647223 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.647371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.647838 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-tmp\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.647964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.647873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-etc-tuned\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.648639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.648612 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-ovn-node-metrics-cert\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.654991 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.654973 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:52:34.655097 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.654994 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:52:34.655097 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.655009 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:34.655097 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:34.655078 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:35.155060713 +0000 UTC m=+3.121822471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:34.657581 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.657558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmdcs\" (UniqueName: \"kubernetes.io/projected/f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4-kube-api-access-wmdcs\") pod \"tuned-m9zb5\" (UID: \"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4\") " pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.657819 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.657796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhzm\" (UniqueName: \"kubernetes.io/projected/7b178de4-ff32-4f71-ace9-fd0ae3e26280-kube-api-access-pmhzm\") pod \"node-ca-98jws\" (UID: \"7b178de4-ff32-4f71-ace9-fd0ae3e26280\") " pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.657996 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.657975 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz4r9\" (UniqueName: \"kubernetes.io/projected/684b1ef2-da7c-4408-8a57-9cd9f8ce01a0-kube-api-access-vz4r9\") pod \"multus-additional-cni-plugins-tm9sx\" (UID: \"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0\") " pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.658079 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.658066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6xxt\" (UniqueName: \"kubernetes.io/projected/966e40a6-12aa-4008-af5e-79ad1884aa83-kube-api-access-f6xxt\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:34.658411 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.658393 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwnp4\" (UniqueName: \"kubernetes.io/projected/3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5-kube-api-access-cwnp4\") pod \"ovnkube-node-6n5w8\" (UID: \"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.747607 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747576 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6h98\" (UniqueName: \"kubernetes.io/projected/e4f3e90c-c42e-44f8-a18b-786af0495f30-kube-api-access-j6h98\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.747607 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747611 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-multus-certs\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747629 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747646 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-hostroot\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747671 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/362fcd77-1677-4840-830d-b27bf923a874-tmp-dir\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747697 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-system-cni-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-multus-certs\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747730 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-hostroot\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747723 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-daemon-config\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747781 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-system-cni-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747790 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-socket-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.747835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747820 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-etc-selinux\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747867 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-cni-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747884 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-socket-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747892 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-socket-dir-parent\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747918 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-etc-kubernetes\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747939 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-cni-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747945 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2dlb\" (UniqueName: \"kubernetes.io/projected/362fcd77-1677-4840-830d-b27bf923a874-kube-api-access-p2dlb\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747976 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7kp\" (UniqueName: \"kubernetes.io/projected/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-kube-api-access-fn7kp\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-socket-dir-parent\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.747989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-etc-selinux\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748001 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-cni-binary-copy\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-etc-kubernetes\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748040 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-kubelet\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748068 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-device-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748076 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/362fcd77-1677-4840-830d-b27bf923a874-tmp-dir\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748094 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-sys-fs\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748119 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0575fb3f-7adb-4c61-b3e9-37271e730c0b-agent-certs\") pod \"konnectivity-agent-dxv6d\" (UID: \"0575fb3f-7adb-4c61-b3e9-37271e730c0b\") " pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748130 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-kubelet\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.748340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748144 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-cnibin\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748168 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-cni-multus\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748195 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-iptables-alerter-script\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748211 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-sys-fs\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748220 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-k8s-cni-cncf-io\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748248 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-host-slash\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-device-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748265 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-daemon-config\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748273 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-cni-bin\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-cni-multus\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748332 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-conf-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748349 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-k8s-cni-cncf-io\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748364 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-netns\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748370 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-cnibin\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748391 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfv7m\" (UniqueName: \"kubernetes.io/projected/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-kube-api-access-vfv7m\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748414 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-var-lib-cni-bin\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748414 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/362fcd77-1677-4840-830d-b27bf923a874-hosts-file\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748450 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-registration-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.749033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-host-slash\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748483 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0575fb3f-7adb-4c61-b3e9-37271e730c0b-konnectivity-ca\") pod \"konnectivity-agent-dxv6d\" (UID: \"0575fb3f-7adb-4c61-b3e9-37271e730c0b\") " pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748506 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4f3e90c-c42e-44f8-a18b-786af0495f30-registration-dir\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748521 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-os-release\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-multus-conf-dir\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748593 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-host-run-netns\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-os-release\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-cni-binary-copy\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748817 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/362fcd77-1677-4840-830d-b27bf923a874-hosts-file\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.748856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-iptables-alerter-script\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.749587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.749042 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0575fb3f-7adb-4c61-b3e9-37271e730c0b-konnectivity-ca\") pod \"konnectivity-agent-dxv6d\" (UID: \"0575fb3f-7adb-4c61-b3e9-37271e730c0b\") " pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.750479 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.750465 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0575fb3f-7adb-4c61-b3e9-37271e730c0b-agent-certs\") pod \"konnectivity-agent-dxv6d\" (UID: \"0575fb3f-7adb-4c61-b3e9-37271e730c0b\") " pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.755902 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.755882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfv7m\" (UniqueName: \"kubernetes.io/projected/0746c2c7-a3d7-47bb-8cf4-b8f6425693f3-kube-api-access-vfv7m\") pod \"multus-vn94b\" (UID: \"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3\") " pod="openshift-multus/multus-vn94b" May 28 14:52:34.756025 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.756007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6h98\" (UniqueName: \"kubernetes.io/projected/e4f3e90c-c42e-44f8-a18b-786af0495f30-kube-api-access-j6h98\") pod \"aws-ebs-csi-driver-node-b9b87\" (UID: \"e4f3e90c-c42e-44f8-a18b-786af0495f30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.756480 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.756458 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7kp\" (UniqueName: \"kubernetes.io/projected/8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7-kube-api-access-fn7kp\") pod \"iptables-alerter-9qrhs\" (UID: \"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7\") " pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.756712 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.756696 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2dlb\" (UniqueName: \"kubernetes.io/projected/362fcd77-1677-4840-830d-b27bf923a874-kube-api-access-p2dlb\") pod \"node-resolver-9xjw2\" (UID: \"362fcd77-1677-4840-830d-b27bf923a874\") " pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.838611 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.838532 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" May 28 14:52:34.847324 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.847290 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" May 28 14:52:34.856098 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.856074 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:34.860715 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.860696 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98jws" May 28 14:52:34.865211 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.865190 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vn94b" May 28 14:52:34.871733 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.871716 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" May 28 14:52:34.879255 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.879231 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:34.885847 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.885832 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qrhs" May 28 14:52:34.892390 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.892369 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9xjw2" May 28 14:52:34.896353 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:34.896333 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 14:52:35.151033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.150957 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:35.151183 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:35.151079 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:35.151183 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:35.151150 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:36.151128834 +0000 UTC m=+4.117890597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:35.252213 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.252183 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:35.252341 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:35.252326 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:52:35.252341 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:35.252342 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:52:35.252484 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:35.252350 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:35.252484 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:35.252396 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:36.252383352 +0000 UTC m=+4.219145095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:35.269452 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.269366 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684b1ef2_da7c_4408_8a57_9cd9f8ce01a0.slice/crio-d7d25b2c379c5b122a699ec52bee66c2962eec5e6bd9a0f2270f4595dbf30164 WatchSource:0}: Error finding container d7d25b2c379c5b122a699ec52bee66c2962eec5e6bd9a0f2270f4595dbf30164: Status 404 returned error can't find the container with id d7d25b2c379c5b122a699ec52bee66c2962eec5e6bd9a0f2270f4595dbf30164 May 28 14:52:35.270217 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.270186 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a2cfa0_e07b_4f5f_a720_d38f23fdf4c4.slice/crio-876d92efaaa9ad0bf5c54df9278625d504fb8d57d472f52aa88f91ed654377af WatchSource:0}: Error finding container 876d92efaaa9ad0bf5c54df9278625d504fb8d57d472f52aa88f91ed654377af: Status 404 returned error can't find the container with id 876d92efaaa9ad0bf5c54df9278625d504fb8d57d472f52aa88f91ed654377af May 28 14:52:35.273981 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.273957 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362fcd77_1677_4840_830d_b27bf923a874.slice/crio-94f1e18fed680fd78ee51af667c58fbd0e072261fb8c6b727cc069e20e3b7b5f WatchSource:0}: Error finding container 94f1e18fed680fd78ee51af667c58fbd0e072261fb8c6b727cc069e20e3b7b5f: Status 404 returned error can't find the container with id 94f1e18fed680fd78ee51af667c58fbd0e072261fb8c6b727cc069e20e3b7b5f May 28 14:52:35.274943 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.274924 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f3e90c_c42e_44f8_a18b_786af0495f30.slice/crio-1ed71909aea094705c353f09ac930fc68e6fae4537ec91394270c6f2c53fec45 WatchSource:0}: Error finding container 1ed71909aea094705c353f09ac930fc68e6fae4537ec91394270c6f2c53fec45: Status 404 returned error can't find the container with id 1ed71909aea094705c353f09ac930fc68e6fae4537ec91394270c6f2c53fec45 May 28 14:52:35.276517 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.276193 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0575fb3f_7adb_4c61_b3e9_37271e730c0b.slice/crio-77db5e1f4bde92b8cdc52aad13b632c8c9e1047be78d2795cce367d209f1342c WatchSource:0}: Error finding container 77db5e1f4bde92b8cdc52aad13b632c8c9e1047be78d2795cce367d209f1342c: Status 404 returned error can't find the container with id 77db5e1f4bde92b8cdc52aad13b632c8c9e1047be78d2795cce367d209f1342c May 28 14:52:35.277076 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.277040 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b178de4_ff32_4f71_ace9_fd0ae3e26280.slice/crio-e20c739ed4e23e7e20926743d034842fcb363780d0363fbd0b3420f465e2f639 WatchSource:0}: Error finding container e20c739ed4e23e7e20926743d034842fcb363780d0363fbd0b3420f465e2f639: Status 404 returned error can't find the container with id e20c739ed4e23e7e20926743d034842fcb363780d0363fbd0b3420f465e2f639 May 28 14:52:35.278542 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.277784 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab3d5a3_ed04_40cd_b0d9_1d9a8b36cdc5.slice/crio-61c9400108571a40ad37f0307d355dc478fb21151858046c0673b35e0862aa45 WatchSource:0}: Error finding container 61c9400108571a40ad37f0307d355dc478fb21151858046c0673b35e0862aa45: Status 404 returned error can't find the container with id 61c9400108571a40ad37f0307d355dc478fb21151858046c0673b35e0862aa45 May 28 14:52:35.280509 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.279991 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0746c2c7_a3d7_47bb_8cf4_b8f6425693f3.slice/crio-34d99a121baf17b43b17e85e78d21bac3367e90d64958b0d25b63dac75c034e6 WatchSource:0}: Error finding container 34d99a121baf17b43b17e85e78d21bac3367e90d64958b0d25b63dac75c034e6: Status 404 returned error can't find the container with id 34d99a121baf17b43b17e85e78d21bac3367e90d64958b0d25b63dac75c034e6 May 28 14:52:35.280509 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:52:35.280185 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8362cd29_a5b6_4f7f_8fae_f8865f8bd7c7.slice/crio-ce457f867a27cdbf883cad6f3f3bfcc1dd786c52e5b5ff52fa14fa74fa7c014b WatchSource:0}: Error finding container ce457f867a27cdbf883cad6f3f3bfcc1dd786c52e5b5ff52fa14fa74fa7c014b: Status 404 returned error can't find the container with id ce457f867a27cdbf883cad6f3f3bfcc1dd786c52e5b5ff52fa14fa74fa7c014b May 28 14:52:35.603578 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.603403 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 14:47:33 +0000 UTC" deadline="2027-12-14 00:37:11.070362533 +0000 UTC" May 28 14:52:35.603578 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.603579 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13545h44m35.466787852s" May 28 14:52:35.642486 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.642453 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" event={"ID":"e4f3e90c-c42e-44f8-a18b-786af0495f30","Type":"ContainerStarted","Data":"1ed71909aea094705c353f09ac930fc68e6fae4537ec91394270c6f2c53fec45"} May 28 14:52:35.643379 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.643346 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"61c9400108571a40ad37f0307d355dc478fb21151858046c0673b35e0862aa45"} May 28 14:52:35.644081 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.644055 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98jws" event={"ID":"7b178de4-ff32-4f71-ace9-fd0ae3e26280","Type":"ContainerStarted","Data":"e20c739ed4e23e7e20926743d034842fcb363780d0363fbd0b3420f465e2f639"} May 28 14:52:35.644983 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.644964 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxv6d" event={"ID":"0575fb3f-7adb-4c61-b3e9-37271e730c0b","Type":"ContainerStarted","Data":"77db5e1f4bde92b8cdc52aad13b632c8c9e1047be78d2795cce367d209f1342c"} May 28 14:52:35.645737 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.645718 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9xjw2" event={"ID":"362fcd77-1677-4840-830d-b27bf923a874","Type":"ContainerStarted","Data":"94f1e18fed680fd78ee51af667c58fbd0e072261fb8c6b727cc069e20e3b7b5f"} May 28 14:52:35.646519 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.646500 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerStarted","Data":"d7d25b2c379c5b122a699ec52bee66c2962eec5e6bd9a0f2270f4595dbf30164"} May 28 14:52:35.648091 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.648067 2555 generic.go:358] "Generic (PLEG): container finished" podID="d5f247a02cd64a7699e96f1ae12f62c6" containerID="f2f4cd7d834e8c721d119778e1c3ff54608993e20b2c0f03e2e627c80a15ca1d" exitCode=0 May 28 14:52:35.648185 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.648131 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" event={"ID":"d5f247a02cd64a7699e96f1ae12f62c6","Type":"ContainerDied","Data":"f2f4cd7d834e8c721d119778e1c3ff54608993e20b2c0f03e2e627c80a15ca1d"} May 28 14:52:35.649144 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.649115 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qrhs" event={"ID":"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7","Type":"ContainerStarted","Data":"ce457f867a27cdbf883cad6f3f3bfcc1dd786c52e5b5ff52fa14fa74fa7c014b"} May 28 14:52:35.650017 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.649996 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vn94b" event={"ID":"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3","Type":"ContainerStarted","Data":"34d99a121baf17b43b17e85e78d21bac3367e90d64958b0d25b63dac75c034e6"} May 28 14:52:35.651000 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.650970 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" event={"ID":"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4","Type":"ContainerStarted","Data":"876d92efaaa9ad0bf5c54df9278625d504fb8d57d472f52aa88f91ed654377af"} May 28 14:52:35.652227 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:35.652207 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" event={"ID":"b6ff3f21836bc88daa29afcf104c5cc9","Type":"ContainerStarted","Data":"6f668b6096edaee6da1343e38cfa045c3a07307fea085d6b9c49b12ac7a9faae"} May 28 14:52:36.159490 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:36.159452 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:36.159683 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.159604 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:36.159683 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.159666 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:38.159647524 +0000 UTC m=+6.126409269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:36.261209 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:36.260571 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:36.261209 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.260771 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:52:36.261209 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.260792 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:52:36.261209 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.260804 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:36.261209 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.260864 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:38.260845875 +0000 UTC m=+6.227607621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:36.635468 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:36.635389 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:36.635884 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.635515 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:36.637371 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:36.637344 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:36.637517 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:36.637473 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:36.668258 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:36.668211 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" event={"ID":"d5f247a02cd64a7699e96f1ae12f62c6","Type":"ContainerStarted","Data":"c79ca0a47d0bb4c1d16c2dbe042c8c593c0a0d6154f4c24297a22d39db854c82"} May 28 14:52:36.682826 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:36.681537 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-234.ec2.internal" podStartSLOduration=2.681519602 podStartE2EDuration="2.681519602s" podCreationTimestamp="2026-05-28 14:52:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:52:35.676538545 +0000 UTC m=+3.643300311" watchObservedRunningTime="2026-05-28 14:52:36.681519602 +0000 UTC m=+4.648281369" May 28 14:52:38.175186 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:38.175105 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:38.175633 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.175236 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:38.175633 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.175295 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:42.175277449 +0000 UTC m=+10.142039205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:38.275477 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:38.275443 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:38.275637 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.275584 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:52:38.275637 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.275605 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:52:38.275637 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.275617 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:38.275798 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.275669 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:42.275651027 +0000 UTC m=+10.242412776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:38.637568 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:38.637411 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:38.637568 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.637541 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:38.637784 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:38.637638 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:38.637784 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:38.637750 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:40.636251 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:40.635565 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:40.636251 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:40.635686 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:40.636251 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:40.636088 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:40.636251 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:40.636200 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:42.206055 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:42.206015 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:42.206535 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.206191 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:42.206535 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.206276 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:50.206256111 +0000 UTC m=+18.173017874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:42.307416 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:42.307380 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:42.307589 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.307549 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:52:42.307589 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.307566 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:52:42.307589 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.307579 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:42.307736 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.307641 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:52:50.307623364 +0000 UTC m=+18.274385118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:42.636515 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:42.636436 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:42.636653 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.636540 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:42.636809 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:42.636780 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:42.636940 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:42.636907 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:44.634725 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:44.634656 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:44.635176 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:44.634781 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:44.635176 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:44.634822 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:44.635176 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:44.634911 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:46.635686 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:46.635650 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:46.636134 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:46.635661 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:46.636134 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:46.635773 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:46.636134 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:46.635837 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:48.635460 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:48.635424 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:48.635783 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:48.635524 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:48.635783 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:48.635580 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:48.635783 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:48.635681 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:50.264405 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:50.264368 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:50.264920 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.264483 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:50.264920 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.264552 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:06.264532941 +0000 UTC m=+34.231294705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:52:50.365099 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:50.365057 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:50.365278 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.365231 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:52:50.365278 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.365255 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:52:50.365278 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.365267 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:50.365459 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.365346 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:06.365326225 +0000 UTC m=+34.332087984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:52:50.635440 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:50.635351 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:50.635604 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.635477 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:50.635604 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:50.635352 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:50.635604 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:50.635597 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:52.635589 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:52.635559 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:52.635994 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:52.635669 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:52.635994 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:52.635707 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:52.635994 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:52.635740 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:53.696955 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.696753 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vn94b" event={"ID":"0746c2c7-a3d7-47bb-8cf4-b8f6425693f3","Type":"ContainerStarted","Data":"35d7a9a8f110076dc40e8e73e4a2ac0a4c24a9142d260e7a191f8a127c7703ae"} May 28 14:52:53.698147 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.698121 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" event={"ID":"f7a2cfa0-e07b-4f5f-a720-d38f23fdf4c4","Type":"ContainerStarted","Data":"fede07474e87a72ec2609d2b40057578d0e462c99cf08d92090bf4702d8cb04e"} May 28 14:52:53.699455 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.699434 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" event={"ID":"e4f3e90c-c42e-44f8-a18b-786af0495f30","Type":"ContainerStarted","Data":"245322f01a8fce35f99eeaf019a7338214e764d78de0efe6a1308272b8354244"} May 28 14:52:53.700823 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.700802 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98jws" event={"ID":"7b178de4-ff32-4f71-ace9-fd0ae3e26280","Type":"ContainerStarted","Data":"99f43b64f85cb7f05ce2e74c88b2797bb5c3fa8955d1050b541c2e52f7052d1a"} May 28 14:52:53.702010 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.701983 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxv6d" event={"ID":"0575fb3f-7adb-4c61-b3e9-37271e730c0b","Type":"ContainerStarted","Data":"39daf480558a14a12561219f2e3affedaa880104fa15fa4d192a6b8c128a23e7"} May 28 14:52:53.703293 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.703269 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9xjw2" event={"ID":"362fcd77-1677-4840-830d-b27bf923a874","Type":"ContainerStarted","Data":"536477ea4701e30f89b6ee3c6dc517a5616d0aa4d3e7eacedfcdecf6d4753501"} May 28 14:52:53.704574 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.704552 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerStarted","Data":"194bd83129e5da2f8bf979e871934a759c31f381ebb79920e120a32533d17459"} May 28 14:52:53.712928 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.712897 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-234.ec2.internal" podStartSLOduration=19.712886799 podStartE2EDuration="19.712886799s" podCreationTimestamp="2026-05-28 14:52:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:52:36.682779221 +0000 UTC m=+4.649540988" watchObservedRunningTime="2026-05-28 14:52:53.712886799 +0000 UTC m=+21.679648564" May 28 14:52:53.713221 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.713202 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vn94b" podStartSLOduration=3.647956206 podStartE2EDuration="21.713196503s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.283495444 +0000 UTC m=+3.250257201" lastFinishedPulling="2026-05-28 14:52:53.348735754 +0000 UTC m=+21.315497498" observedRunningTime="2026-05-28 14:52:53.712666155 +0000 UTC m=+21.679427919" watchObservedRunningTime="2026-05-28 14:52:53.713196503 +0000 UTC m=+21.679958268" May 28 14:52:53.740821 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.740781 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-98jws" podStartSLOduration=3.702979328 podStartE2EDuration="21.74076844s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.279693807 +0000 UTC m=+3.246455550" lastFinishedPulling="2026-05-28 14:52:53.317482907 +0000 UTC m=+21.284244662" observedRunningTime="2026-05-28 14:52:53.740246067 +0000 UTC m=+21.707007829" watchObservedRunningTime="2026-05-28 14:52:53.74076844 +0000 UTC m=+21.707530204" May 28 14:52:53.751537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.751500 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dxv6d" podStartSLOduration=3.753496947 podStartE2EDuration="21.751489468s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.27852347 +0000 UTC m=+3.245285215" lastFinishedPulling="2026-05-28 14:52:53.276515978 +0000 UTC m=+21.243277736" observedRunningTime="2026-05-28 14:52:53.751321438 +0000 UTC m=+21.718083194" watchObservedRunningTime="2026-05-28 14:52:53.751489468 +0000 UTC m=+21.718251233" May 28 14:52:53.765346 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:53.765290 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9xjw2" podStartSLOduration=2.723852967 podStartE2EDuration="20.765277566s" podCreationTimestamp="2026-05-28 14:52:33 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.275906327 +0000 UTC m=+3.242668071" lastFinishedPulling="2026-05-28 14:52:53.317330911 +0000 UTC m=+21.284092670" observedRunningTime="2026-05-28 14:52:53.764842355 +0000 UTC m=+21.731604119" watchObservedRunningTime="2026-05-28 14:52:53.765277566 +0000 UTC m=+21.732039330" May 28 14:52:54.635492 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.635288 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:54.635579 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.635300 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:54.635579 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:54.635537 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:54.635661 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:54.635623 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:54.707399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.707252 2555 generic.go:358] "Generic (PLEG): container finished" podID="684b1ef2-da7c-4408-8a57-9cd9f8ce01a0" containerID="194bd83129e5da2f8bf979e871934a759c31f381ebb79920e120a32533d17459" exitCode=0 May 28 14:52:54.707399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.707343 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerDied","Data":"194bd83129e5da2f8bf979e871934a759c31f381ebb79920e120a32533d17459"} May 28 14:52:54.709091 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.709064 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qrhs" event={"ID":"8362cd29-a5b6-4f7f-8fae-f8865f8bd7c7","Type":"ContainerStarted","Data":"d1a82595d300859d68f538032fa6e9525bc2de99cca5217bfe1b8106b8bcc151"} May 28 14:52:54.711661 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.711585 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"22bb0bab1a4f610de965ea7a40ff7e09a26b348f115b678d1a6905b5c11ff5bc"} May 28 14:52:54.711661 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.711630 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"3d935256590ffa82c9b6011b9d0275883305b553e83ebecd24bf9faf3655aaac"} May 28 14:52:54.711661 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.711644 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"c953067a91fa4f5116e348935ffeb14650df6268f75cb254427b830bad1858c5"} May 28 14:52:54.711661 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.711656 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"0f85785de06218da07eb27f59fc92ac139e0e7f8dd9b8cced4ec01d78ed7c686"} May 28 14:52:54.740443 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.740406 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m9zb5" podStartSLOduration=4.693207393 podStartE2EDuration="22.740394048s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.272645104 +0000 UTC m=+3.239406848" lastFinishedPulling="2026-05-28 14:52:53.319831759 +0000 UTC m=+21.286593503" observedRunningTime="2026-05-28 14:52:53.784600644 +0000 UTC m=+21.751362430" watchObservedRunningTime="2026-05-28 14:52:54.740394048 +0000 UTC m=+22.707155812" May 28 14:52:54.751687 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.751653 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9qrhs" podStartSLOduration=4.758670297 podStartE2EDuration="22.751641731s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.283546974 +0000 UTC m=+3.250308719" lastFinishedPulling="2026-05-28 14:52:53.276518387 +0000 UTC m=+21.243280153" observedRunningTime="2026-05-28 14:52:54.751636799 +0000 UTC m=+22.718398565" watchObservedRunningTime="2026-05-28 14:52:54.751641731 +0000 UTC m=+22.718403495" May 28 14:52:54.762273 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:54.762257 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 14:52:55.607504 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.607291 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T14:52:54.76227026Z","UUID":"6c142011-569e-44af-843c-d3a149c14774","Handler":null,"Name":"","Endpoint":""} May 28 14:52:55.609873 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.609856 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 14:52:55.609964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.609880 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 14:52:55.716021 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.715988 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"5cc30e4d1ab270c0bcf8afb75ed54ed18ec9ccb319868ec51aaece6c18f1f4ab"} May 28 14:52:55.716464 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.716030 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"6a0841a78efe6ecf84b1e86a458d767de6efc8df32476b0166b5c9fd62b212ed"} May 28 14:52:55.717897 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.717865 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" event={"ID":"e4f3e90c-c42e-44f8-a18b-786af0495f30","Type":"ContainerStarted","Data":"dc69719b4c70f9e28e5eb60236f902c89b5205fce7d54156d3427de20b622935"} May 28 14:52:55.718005 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.717901 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" event={"ID":"e4f3e90c-c42e-44f8-a18b-786af0495f30","Type":"ContainerStarted","Data":"3cb29131a7a5a3096b65d669e65829bdc84b5e18fd1db225e67027a2a4c3481a"} May 28 14:52:55.735897 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:55.735852 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b9b87" podStartSLOduration=3.507146233 podStartE2EDuration="23.735837138s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.276999575 +0000 UTC m=+3.243761333" lastFinishedPulling="2026-05-28 14:52:55.50569049 +0000 UTC m=+23.472452238" observedRunningTime="2026-05-28 14:52:55.73574666 +0000 UTC m=+23.702508425" watchObservedRunningTime="2026-05-28 14:52:55.735837138 +0000 UTC m=+23.702598967" May 28 14:52:56.635219 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:56.635182 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:56.635456 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:56.635322 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:56.635456 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:56.635393 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:56.635573 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:56.635516 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:57.417193 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:57.417158 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:57.417899 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:57.417826 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dxv6d" May 28 14:52:57.725633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:57.725561 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"da46719e13c5e8f411276b9ccbd3e136d7cb39edf265f66fdaef957242e7cd09"} May 28 14:52:58.635485 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:58.635454 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:52:58.636007 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:58.635588 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:52:58.636007 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:58.635715 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:52:58.636007 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:52:58.635836 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:52:59.734491 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.734251 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" event={"ID":"3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5","Type":"ContainerStarted","Data":"703431ea1800fd0384f10bd14ab1eb449783919206f103155c8a408b8bdba64c"} May 28 14:52:59.734945 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.734529 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:59.734945 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.734676 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:59.735930 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.735909 2555 generic.go:358] "Generic (PLEG): container finished" podID="684b1ef2-da7c-4408-8a57-9cd9f8ce01a0" containerID="5620812121ad621babe14381bf1ce1a2d803ebd67e399a7e7f500f425b2a72ed" exitCode=0 May 28 14:52:59.736050 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.735943 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerDied","Data":"5620812121ad621babe14381bf1ce1a2d803ebd67e399a7e7f500f425b2a72ed"} May 28 14:52:59.749749 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.749725 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:52:59.760444 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:52:59.760411 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" podStartSLOduration=8.955077246 podStartE2EDuration="27.760400139s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.281004198 +0000 UTC m=+3.247765952" lastFinishedPulling="2026-05-28 14:52:54.086327094 +0000 UTC m=+22.053088845" observedRunningTime="2026-05-28 14:52:59.760021306 +0000 UTC m=+27.726783071" watchObservedRunningTime="2026-05-28 14:52:59.760400139 +0000 UTC m=+27.727161905" May 28 14:53:00.085657 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.085620 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dxv6d" May 28 14:53:00.085857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.085770 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 14:53:00.086197 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.086175 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dxv6d" May 28 14:53:00.635082 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.635056 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:00.635082 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.635070 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:00.635409 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:00.635143 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:53:00.635409 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:00.635285 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:53:00.690039 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.690011 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rxmjw"] May 28 14:53:00.714030 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.714001 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.714178 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:00.714100 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxmjw" podUID="e282f7f3-eb8f-45f8-8f1c-de556e30a556" May 28 14:53:00.737892 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.737872 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:53:00.751886 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.751864 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:53:00.851535 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.851497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e282f7f3-eb8f-45f8-8f1c-de556e30a556-dbus\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.851858 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.851545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.851858 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.851573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e282f7f3-eb8f-45f8-8f1c-de556e30a556-kubelet-config\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.953002 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.952973 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.953002 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.953004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e282f7f3-eb8f-45f8-8f1c-de556e30a556-kubelet-config\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.953163 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.953059 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e282f7f3-eb8f-45f8-8f1c-de556e30a556-dbus\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.953163 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:00.953120 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 14:53:00.953163 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.953142 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e282f7f3-eb8f-45f8-8f1c-de556e30a556-kubelet-config\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:00.953346 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:00.953195 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret podName:e282f7f3-eb8f-45f8-8f1c-de556e30a556 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:01.453175738 +0000 UTC m=+29.419937498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret") pod "global-pull-secret-syncer-rxmjw" (UID: "e282f7f3-eb8f-45f8-8f1c-de556e30a556") : object "kube-system"/"original-pull-secret" not registered May 28 14:53:00.953346 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:00.953224 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e282f7f3-eb8f-45f8-8f1c-de556e30a556-dbus\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:01.265161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.265055 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrsft"] May 28 14:53:01.265161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.265163 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:01.265390 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:01.265235 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:53:01.268250 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.268228 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qbj7c"] May 28 14:53:01.268390 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.268340 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:01.268436 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:01.268419 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:53:01.281952 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.281931 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxmjw"] May 28 14:53:01.282064 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.282012 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:01.282102 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:01.282078 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxmjw" podUID="e282f7f3-eb8f-45f8-8f1c-de556e30a556" May 28 14:53:01.458168 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.458136 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:01.458346 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:01.458252 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 14:53:01.458346 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:01.458300 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret podName:e282f7f3-eb8f-45f8-8f1c-de556e30a556 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:02.458287631 +0000 UTC m=+30.425049374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret") pod "global-pull-secret-syncer-rxmjw" (UID: "e282f7f3-eb8f-45f8-8f1c-de556e30a556") : object "kube-system"/"original-pull-secret" not registered May 28 14:53:01.740380 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.740340 2555 generic.go:358] "Generic (PLEG): container finished" podID="684b1ef2-da7c-4408-8a57-9cd9f8ce01a0" containerID="973e4c7df49066901da77549d80c563b47d8b2bd3f000823e7bee14ea787167b" exitCode=0 May 28 14:53:01.740798 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:01.740436 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerDied","Data":"973e4c7df49066901da77549d80c563b47d8b2bd3f000823e7bee14ea787167b"} May 28 14:53:02.466761 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:02.466734 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:02.466912 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:02.466872 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 14:53:02.466960 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:02.466936 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret podName:e282f7f3-eb8f-45f8-8f1c-de556e30a556 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:04.466912415 +0000 UTC m=+32.433674171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret") pod "global-pull-secret-syncer-rxmjw" (UID: "e282f7f3-eb8f-45f8-8f1c-de556e30a556") : object "kube-system"/"original-pull-secret" not registered May 28 14:53:02.635353 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:02.635328 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:02.635512 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:02.635367 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:02.635512 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:02.635403 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:53:02.635599 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:02.635545 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:02.635599 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:02.635550 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxmjw" podUID="e282f7f3-eb8f-45f8-8f1c-de556e30a556" May 28 14:53:02.635676 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:02.635652 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:53:03.746047 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:03.745747 2555 generic.go:358] "Generic (PLEG): container finished" podID="684b1ef2-da7c-4408-8a57-9cd9f8ce01a0" containerID="bb935be23c1f564d646e0ba27a415361016edb0703487d75b37a7a0e76ffc8f4" exitCode=0 May 28 14:53:03.746047 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:03.745829 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerDied","Data":"bb935be23c1f564d646e0ba27a415361016edb0703487d75b37a7a0e76ffc8f4"} May 28 14:53:04.481445 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:04.481411 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:04.481610 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:04.481566 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 14:53:04.481660 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:04.481636 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret podName:e282f7f3-eb8f-45f8-8f1c-de556e30a556 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:08.48162126 +0000 UTC m=+36.448383007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret") pod "global-pull-secret-syncer-rxmjw" (UID: "e282f7f3-eb8f-45f8-8f1c-de556e30a556") : object "kube-system"/"original-pull-secret" not registered May 28 14:53:04.635576 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:04.635544 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:04.635753 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:04.635544 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:04.635753 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:04.635669 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:53:04.635753 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:04.635549 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:04.635912 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:04.635794 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxmjw" podUID="e282f7f3-eb8f-45f8-8f1c-de556e30a556" May 28 14:53:04.635912 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:04.635818 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:53:06.294463 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:06.294429 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:06.295073 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.294600 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:53:06.295073 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.294673 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:38.294654471 +0000 UTC m=+66.261416218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 14:53:06.395723 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:06.395685 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:06.395874 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.395830 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 14:53:06.395874 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.395850 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 14:53:06.395874 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.395860 2555 projected.go:194] Error preparing data for projected volume kube-api-access-ptqnm for pod openshift-network-diagnostics/network-check-target-wrsft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:53:06.395990 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.395908 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm podName:09ebf6b8-1551-407d-9a67-ddd2054355c1 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:38.395896128 +0000 UTC m=+66.362657872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptqnm" (UniqueName: "kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm") pod "network-check-target-wrsft" (UID: "09ebf6b8-1551-407d-9a67-ddd2054355c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 14:53:06.634771 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:06.634737 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:06.634950 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.634858 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:53:06.634950 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:06.634889 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:06.634950 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:06.634907 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:06.635115 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.635016 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrsft" podUID="09ebf6b8-1551-407d-9a67-ddd2054355c1" May 28 14:53:06.635193 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:06.635167 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxmjw" podUID="e282f7f3-eb8f-45f8-8f1c-de556e30a556" May 28 14:53:07.315246 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.315170 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-234.ec2.internal" event="NodeReady" May 28 14:53:07.315649 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.315331 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 14:53:07.350649 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.350619 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67648996fb-xr64t"] May 28 14:53:07.352414 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.352398 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.355147 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.355128 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 14:53:07.355418 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.355391 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbq8w\"" May 28 14:53:07.355662 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.355646 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 14:53:07.355928 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.355913 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 14:53:07.361263 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.361239 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4m795"] May 28 14:53:07.361570 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.361487 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 14:53:07.363049 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.363031 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:07.365567 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.365551 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 14:53:07.365660 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.365586 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znwr4\"" May 28 14:53:07.365660 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.365597 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 14:53:07.365660 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.365600 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 14:53:07.367528 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.367506 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67648996fb-xr64t"] May 28 14:53:07.375772 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.375741 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4m795"] May 28 14:53:07.459700 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.459672 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x2xxq"] May 28 14:53:07.461578 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.461561 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.464194 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.464168 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 14:53:07.464194 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.464176 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 14:53:07.464385 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.464180 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqk5j\"" May 28 14:53:07.470802 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.470781 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2xxq"] May 28 14:53:07.503609 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbpt\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-kube-api-access-5gbpt\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.503769 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503614 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-certificates\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.503769 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6d5g\" (UniqueName: \"kubernetes.io/projected/d0c535af-3f69-47c1-8395-c245d1726748-kube-api-access-j6d5g\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:07.503769 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503740 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-trusted-ca\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.503916 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-image-registry-private-configuration\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.503916 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503809 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.503916 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503852 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-installation-pull-secrets\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.503916 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.503885 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:07.504470 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.504433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-bound-sa-token\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.504572 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.504497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea536094-e4d0-4dc1-a014-7692c35b9917-ca-trust-extracted\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605043 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605010 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbpt\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-kube-api-access-5gbpt\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605205 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605052 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-certificates\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605205 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5c5c98-be38-4857-9844-ab5321c762b5-config-volume\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.605205 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5c5c98-be38-4857-9844-ab5321c762b5-tmp-dir\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.605205 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605113 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89c68\" (UniqueName: \"kubernetes.io/projected/1d5c5c98-be38-4857-9844-ab5321c762b5-kube-api-access-89c68\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.605205 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605163 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6d5g\" (UniqueName: \"kubernetes.io/projected/d0c535af-3f69-47c1-8395-c245d1726748-kube-api-access-j6d5g\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605214 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-trusted-ca\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605235 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-image-registry-private-configuration\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605254 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605304 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-installation-pull-secrets\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605345 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605406 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-bound-sa-token\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.605409 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.605424 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605433 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea536094-e4d0-4dc1-a014-7692c35b9917-ca-trust-extracted\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.605477 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:08.105459855 +0000 UTC m=+36.072221611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:07.605639 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-certificates\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.606117 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.605750 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:07.606117 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.605795 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea536094-e4d0-4dc1-a014-7692c35b9917-ca-trust-extracted\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.606117 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.605806 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:08.105786987 +0000 UTC m=+36.072548744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:07.606213 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.606121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-trusted-ca\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.609415 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.609393 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-installation-pull-secrets\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.609502 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.609393 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-image-registry-private-configuration\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.615731 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.615703 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-bound-sa-token\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.615844 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.615824 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbpt\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-kube-api-access-5gbpt\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:07.616235 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.616215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6d5g\" (UniqueName: \"kubernetes.io/projected/d0c535af-3f69-47c1-8395-c245d1726748-kube-api-access-j6d5g\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:07.706009 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.705952 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.706148 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.706073 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5c5c98-be38-4857-9844-ab5321c762b5-config-volume\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.706148 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.706099 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5c5c98-be38-4857-9844-ab5321c762b5-tmp-dir\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.706148 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.706107 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:07.706148 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.706124 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89c68\" (UniqueName: \"kubernetes.io/projected/1d5c5c98-be38-4857-9844-ab5321c762b5-kube-api-access-89c68\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.706374 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:07.706174 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:08.206153484 +0000 UTC m=+36.172915236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:07.706690 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.706670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d5c5c98-be38-4857-9844-ab5321c762b5-tmp-dir\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.706878 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.706855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5c5c98-be38-4857-9844-ab5321c762b5-config-volume\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:07.715176 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:07.715154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89c68\" (UniqueName: \"kubernetes.io/projected/1d5c5c98-be38-4857-9844-ab5321c762b5-kube-api-access-89c68\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:08.109738 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.109699 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:08.109957 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.109774 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:08.109957 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.109872 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:08.109957 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.109895 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:08.109957 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.109909 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:08.110153 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.109968 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:09.109952608 +0000 UTC m=+37.076714350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:08.110153 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.109982 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:09.109975417 +0000 UTC m=+37.076737159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:08.210292 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.210252 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:08.210457 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.210416 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:08.210516 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.210478 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:09.210463943 +0000 UTC m=+37.177225720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:08.512234 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.512147 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:08.512883 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.512321 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 14:53:08.512883 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:08.512407 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret podName:e282f7f3-eb8f-45f8-8f1c-de556e30a556 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:16.512390543 +0000 UTC m=+44.479152305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret") pod "global-pull-secret-syncer-rxmjw" (UID: "e282f7f3-eb8f-45f8-8f1c-de556e30a556") : object "kube-system"/"original-pull-secret" not registered May 28 14:53:08.635069 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.635025 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:08.635254 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.635086 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:08.635406 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.635027 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:08.639377 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.639354 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 14:53:08.639506 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.639391 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 14:53:08.639506 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.639400 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ckjfk\"" May 28 14:53:08.639506 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.639413 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4kpj5\"" May 28 14:53:08.639506 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.639432 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 14:53:08.639506 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:08.639472 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 14:53:09.117617 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:09.117580 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:09.117799 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:09.117645 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:09.117799 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.117745 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:09.117799 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.117772 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:09.117799 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.117752 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:09.117980 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.117831 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:11.117816555 +0000 UTC m=+39.084578310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:09.117980 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.117846 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:11.117840492 +0000 UTC m=+39.084602235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:09.218071 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:09.218032 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:09.218230 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.218179 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:09.218321 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:09.218243 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:11.218225441 +0000 UTC m=+39.184987204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:11.135842 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:11.135809 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:11.136154 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:11.135875 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:11.136154 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.135960 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:11.136154 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.135979 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:11.136154 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.136020 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:11.136154 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.136037 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:15.13602056 +0000 UTC m=+43.102782313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:11.136154 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.136069 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:15.136055929 +0000 UTC m=+43.102817672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:11.236865 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:11.236836 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:11.237003 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.236985 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:11.237042 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:11.237036 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:15.237021178 +0000 UTC m=+43.203782933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:11.763177 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:11.763147 2555 generic.go:358] "Generic (PLEG): container finished" podID="684b1ef2-da7c-4408-8a57-9cd9f8ce01a0" containerID="6373392c1a109400bb3ccd74e4d3e9c1d2f2137b834532afeb7f878a93366a9c" exitCode=0 May 28 14:53:11.763177 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:11.763190 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerDied","Data":"6373392c1a109400bb3ccd74e4d3e9c1d2f2137b834532afeb7f878a93366a9c"} May 28 14:53:12.767082 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:12.767041 2555 generic.go:358] "Generic (PLEG): container finished" podID="684b1ef2-da7c-4408-8a57-9cd9f8ce01a0" containerID="e29bddbc1ffad345498af2176d1541bc89c2e2155e6c621535142bd362f3969c" exitCode=0 May 28 14:53:12.767436 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:12.767101 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerDied","Data":"e29bddbc1ffad345498af2176d1541bc89c2e2155e6c621535142bd362f3969c"} May 28 14:53:13.771711 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:13.771672 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" event={"ID":"684b1ef2-da7c-4408-8a57-9cd9f8ce01a0","Type":"ContainerStarted","Data":"eb0ac63bb3e13607bee4d0b35502df10592554cfff02b83e2dc6abe6f4db3f1d"} May 28 14:53:13.794854 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:13.794808 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tm9sx" podStartSLOduration=6.292493931 podStartE2EDuration="41.794794473s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:52:35.271327554 +0000 UTC m=+3.238089297" lastFinishedPulling="2026-05-28 14:53:10.773628096 +0000 UTC m=+38.740389839" observedRunningTime="2026-05-28 14:53:13.794138144 +0000 UTC m=+41.760899909" watchObservedRunningTime="2026-05-28 14:53:13.794794473 +0000 UTC m=+41.761556286" May 28 14:53:15.165876 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:15.165836 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:15.166281 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:15.165903 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:15.166281 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.165981 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:15.166281 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.166007 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:15.166281 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.166018 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:15.166281 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.166073 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:23.166057294 +0000 UTC m=+51.132819045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:15.166281 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.166087 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:23.166081513 +0000 UTC m=+51.132843294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:15.266633 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:15.266597 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:15.266785 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.266737 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:15.266829 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:15.266787 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:23.266771114 +0000 UTC m=+51.233532877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:16.575637 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:16.575597 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:16.577878 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:16.577857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e282f7f3-eb8f-45f8-8f1c-de556e30a556-original-pull-secret\") pod \"global-pull-secret-syncer-rxmjw\" (UID: \"e282f7f3-eb8f-45f8-8f1c-de556e30a556\") " pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:16.755826 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:16.755793 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxmjw" May 28 14:53:16.897331 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:16.897290 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxmjw"] May 28 14:53:16.900525 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:53:16.900501 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode282f7f3_eb8f_45f8_8f1c_de556e30a556.slice/crio-eb76d196d0ab20914f548cd65187c686e36d08805e82c79bbd8e235f45afc898 WatchSource:0}: Error finding container eb76d196d0ab20914f548cd65187c686e36d08805e82c79bbd8e235f45afc898: Status 404 returned error can't find the container with id eb76d196d0ab20914f548cd65187c686e36d08805e82c79bbd8e235f45afc898 May 28 14:53:17.780033 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:17.779998 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxmjw" event={"ID":"e282f7f3-eb8f-45f8-8f1c-de556e30a556","Type":"ContainerStarted","Data":"eb76d196d0ab20914f548cd65187c686e36d08805e82c79bbd8e235f45afc898"} May 28 14:53:21.788507 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:21.788474 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxmjw" event={"ID":"e282f7f3-eb8f-45f8-8f1c-de556e30a556","Type":"ContainerStarted","Data":"2cb5f858472ea514a99f6c2b99fcc9e37eec20a920beee7b613d5ce8125ae454"} May 28 14:53:21.802462 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:21.802410 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rxmjw" podStartSLOduration=17.406213053 podStartE2EDuration="21.802394586s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:16.902634964 +0000 UTC m=+44.869396707" lastFinishedPulling="2026-05-28 14:53:21.298816497 +0000 UTC m=+49.265578240" observedRunningTime="2026-05-28 14:53:21.802049412 +0000 UTC m=+49.768811178" watchObservedRunningTime="2026-05-28 14:53:21.802394586 +0000 UTC m=+49.769156362" May 28 14:53:23.225712 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:23.225679 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:23.226081 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:23.225726 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:23.226081 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.225824 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:23.226081 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.225873 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:39.225860461 +0000 UTC m=+67.192622216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:23.226081 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.225825 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:23.226081 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.225910 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:23.226081 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.225956 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:39.225944274 +0000 UTC m=+67.192706017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:23.326235 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:23.326203 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:23.326451 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.326331 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:23.326451 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:23.326388 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:39.326372478 +0000 UTC m=+67.293134239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:32.752418 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:32.752385 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n5w8" May 28 14:53:38.332815 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.332774 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:53:38.335802 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.335783 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 14:53:38.343017 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:38.342993 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 14:53:38.343066 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:38.343053 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:42.343037892 +0000 UTC m=+130.309799635 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : secret "metrics-daemon-secret" not found May 28 14:53:38.433325 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.433277 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:38.438573 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.438552 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 14:53:38.445934 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.445916 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 14:53:38.456125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.456099 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqnm\" (UniqueName: \"kubernetes.io/projected/09ebf6b8-1551-407d-9a67-ddd2054355c1-kube-api-access-ptqnm\") pod \"network-check-target-wrsft\" (UID: \"09ebf6b8-1551-407d-9a67-ddd2054355c1\") " pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:38.651433 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.651354 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ckjfk\"" May 28 14:53:38.658651 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.658625 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:38.775095 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.775066 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrsft"] May 28 14:53:38.778206 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:53:38.778179 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ebf6b8_1551_407d_9a67_ddd2054355c1.slice/crio-bb6e29e6f62e4d3a059de4d431af0ff77f7b60f2a2021d57f69a616736eac68d WatchSource:0}: Error finding container bb6e29e6f62e4d3a059de4d431af0ff77f7b60f2a2021d57f69a616736eac68d: Status 404 returned error can't find the container with id bb6e29e6f62e4d3a059de4d431af0ff77f7b60f2a2021d57f69a616736eac68d May 28 14:53:38.820003 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:38.819976 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrsft" event={"ID":"09ebf6b8-1551-407d-9a67-ddd2054355c1","Type":"ContainerStarted","Data":"bb6e29e6f62e4d3a059de4d431af0ff77f7b60f2a2021d57f69a616736eac68d"} May 28 14:53:39.240638 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:39.240606 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:53:39.240803 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:39.240657 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:53:39.240803 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.240774 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:53:39.240883 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.240856 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:11.240840249 +0000 UTC m=+99.207601998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:53:39.240948 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.240791 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:53:39.240948 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.240901 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:53:39.241030 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.240970 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:11.240952417 +0000 UTC m=+99.207714178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:53:39.341493 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:39.341454 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:53:39.341880 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.341607 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:53:39.341880 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:53:39.341665 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:11.341651548 +0000 UTC m=+99.308413290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:53:41.827705 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:41.827674 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrsft" event={"ID":"09ebf6b8-1551-407d-9a67-ddd2054355c1","Type":"ContainerStarted","Data":"cf0a8c07b11555f942e1b64bb632a0eca11b1b874beff73d8e0811e8eeaa733f"} May 28 14:53:41.828067 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:41.827880 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:53:41.847509 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:53:41.847466 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrsft" podStartSLOduration=66.990111521 podStartE2EDuration="1m9.847453598s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:53:38.780440111 +0000 UTC m=+66.747201853" lastFinishedPulling="2026-05-28 14:53:41.637782184 +0000 UTC m=+69.604543930" observedRunningTime="2026-05-28 14:53:41.847110068 +0000 UTC m=+69.813871834" watchObservedRunningTime="2026-05-28 14:53:41.847453598 +0000 UTC m=+69.814215375" May 28 14:54:11.270069 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:11.270009 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:54:11.270580 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:11.270096 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:54:11.270580 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.270153 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 14:54:11.270580 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.270174 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67648996fb-xr64t: secret "image-registry-tls" not found May 28 14:54:11.270580 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.270213 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 14:54:11.270580 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.270238 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls podName:ea536094-e4d0-4dc1-a014-7692c35b9917 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:15.270222517 +0000 UTC m=+163.236984259 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls") pod "image-registry-67648996fb-xr64t" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917") : secret "image-registry-tls" not found May 28 14:54:11.270580 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.270276 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert podName:d0c535af-3f69-47c1-8395-c245d1726748 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:15.270261067 +0000 UTC m=+163.237022810 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert") pod "ingress-canary-4m795" (UID: "d0c535af-3f69-47c1-8395-c245d1726748") : secret "canary-serving-cert" not found May 28 14:54:11.371303 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:11.371270 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:54:11.371485 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.371442 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 14:54:11.371554 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:11.371516 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls podName:1d5c5c98-be38-4857-9844-ab5321c762b5 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:15.371496601 +0000 UTC m=+163.338258357 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls") pod "dns-default-x2xxq" (UID: "1d5c5c98-be38-4857-9844-ab5321c762b5") : secret "dns-default-metrics-tls" not found May 28 14:54:12.832729 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:12.832705 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrsft" May 28 14:54:42.391170 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:42.391130 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:54:42.391649 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:42.391276 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 14:54:42.391649 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:42.391360 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs podName:966e40a6-12aa-4008-af5e-79ad1884aa83 nodeName:}" failed. No retries permitted until 2026-05-28 14:56:44.391343514 +0000 UTC m=+252.358105275 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs") pod "network-metrics-daemon-qbj7c" (UID: "966e40a6-12aa-4008-af5e-79ad1884aa83") : secret "metrics-daemon-secret" not found May 28 14:54:49.054280 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.054244 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k"] May 28 14:54:49.057060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.057033 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6"] May 28 14:54:49.057217 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.057196 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" May 28 14:54:49.059559 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.059540 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp"] May 28 14:54:49.059684 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.059667 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" May 28 14:54:49.060212 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.060196 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rlswl\"" May 28 14:54:49.061142 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.061125 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 28 14:54:49.061232 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.061142 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 28 14:54:49.061943 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.061926 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nkslr\"" May 28 14:54:49.062031 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.062018 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.064403 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.064385 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 14:54:49.064523 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.064403 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 14:54:49.064671 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.064656 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l66ts\"" May 28 14:54:49.064671 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.064664 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 14:54:49.064788 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.064679 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 14:54:49.068451 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.068429 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k"] May 28 14:54:49.069048 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.069032 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6"] May 28 14:54:49.069900 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.069876 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp"] May 28 14:54:49.132886 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.132859 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/924b2db9-2aa0-4071-a020-93dda946a96a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.133008 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.132895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jf5q\" (UniqueName: \"kubernetes.io/projected/924b2db9-2aa0-4071-a020-93dda946a96a-kube-api-access-2jf5q\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.133008 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.132922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj8vq\" (UniqueName: \"kubernetes.io/projected/1189476e-9a0a-4bba-92e0-56a9e110a7e0-kube-api-access-gj8vq\") pod \"network-check-source-7f44b6dd87-8v9g6\" (UID: \"1189476e-9a0a-4bba-92e0-56a9e110a7e0\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" May 28 14:54:49.133078 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.133006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9ft\" (UniqueName: \"kubernetes.io/projected/d81e70ae-22b0-4064-b389-fc9fa7c44924-kube-api-access-gj9ft\") pod \"volume-data-source-validator-5cf8c89d64-w9c2k\" (UID: \"d81e70ae-22b0-4064-b389-fc9fa7c44924\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" May 28 14:54:49.133078 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.133035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/924b2db9-2aa0-4071-a020-93dda946a96a-config\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.155228 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.155205 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk"] May 28 14:54:49.158070 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.158057 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.160833 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.160815 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 14:54:49.160934 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.160863 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 14:54:49.160934 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.160871 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 14:54:49.161089 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.161074 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zvrfm\"" May 28 14:54:49.162512 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.162495 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-r4m86"] May 28 14:54:49.165489 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.165475 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.167856 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.167840 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6569d6554b-xnz6j"] May 28 14:54:49.168237 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.168219 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 14:54:49.168706 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.168688 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 14:54:49.168805 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.168728 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lzksf\"" May 28 14:54:49.169240 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.169222 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 14:54:49.170478 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.170451 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk"] May 28 14:54:49.170570 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.170550 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.173408 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.173389 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 14:54:49.174545 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.174522 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 14:54:49.174545 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.174537 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 14:54:49.174673 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.174566 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 14:54:49.174890 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.174873 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7dndt\"" May 28 14:54:49.175120 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.175102 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 14:54:49.175204 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.175165 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 14:54:49.175204 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.175196 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 14:54:49.175493 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.175475 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 14:54:49.185586 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.185566 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-r4m86"] May 28 14:54:49.202615 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.202592 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6569d6554b-xnz6j"] May 28 14:54:49.233421 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jshgq\" (UniqueName: \"kubernetes.io/projected/c511bf32-b677-4de5-af87-7ce1b0686870-kube-api-access-jshgq\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.233537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233429 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj8vq\" (UniqueName: \"kubernetes.io/projected/1189476e-9a0a-4bba-92e0-56a9e110a7e0-kube-api-access-gj8vq\") pod \"network-check-source-7f44b6dd87-8v9g6\" (UID: \"1189476e-9a0a-4bba-92e0-56a9e110a7e0\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" May 28 14:54:49.233537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-default-certificate\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.233537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.233537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3474f9e0-ce25-473b-b7e9-51882fcce751-tmp\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.233537 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233536 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3474f9e0-ce25-473b-b7e9-51882fcce751-service-ca-bundle\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.233783 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-stats-auth\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.233783 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.233783 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3474f9e0-ce25-473b-b7e9-51882fcce751-serving-cert\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.233783 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233665 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/924b2db9-2aa0-4071-a020-93dda946a96a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.233783 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfpm\" (UniqueName: \"kubernetes.io/projected/3474f9e0-ce25-473b-b7e9-51882fcce751-kube-api-access-msfpm\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233799 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jf5q\" (UniqueName: \"kubernetes.io/projected/924b2db9-2aa0-4071-a020-93dda946a96a-kube-api-access-2jf5q\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233822 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3474f9e0-ce25-473b-b7e9-51882fcce751-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233840 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smd65\" (UniqueName: \"kubernetes.io/projected/1f0f9c27-07d9-45ff-96eb-931940286665-kube-api-access-smd65\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3474f9e0-ce25-473b-b7e9-51882fcce751-snapshots\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233920 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9ft\" (UniqueName: \"kubernetes.io/projected/d81e70ae-22b0-4064-b389-fc9fa7c44924-kube-api-access-gj9ft\") pod \"volume-data-source-validator-5cf8c89d64-w9c2k\" (UID: \"d81e70ae-22b0-4064-b389-fc9fa7c44924\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" May 28 14:54:49.234014 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.233947 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/924b2db9-2aa0-4071-a020-93dda946a96a-config\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.234465 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.234448 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/924b2db9-2aa0-4071-a020-93dda946a96a-config\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.236090 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.236069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/924b2db9-2aa0-4071-a020-93dda946a96a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.242140 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.242116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jf5q\" (UniqueName: \"kubernetes.io/projected/924b2db9-2aa0-4071-a020-93dda946a96a-kube-api-access-2jf5q\") pod \"kube-storage-version-migrator-operator-565644f49-bpxpp\" (UID: \"924b2db9-2aa0-4071-a020-93dda946a96a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.242601 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.242584 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9ft\" (UniqueName: \"kubernetes.io/projected/d81e70ae-22b0-4064-b389-fc9fa7c44924-kube-api-access-gj9ft\") pod \"volume-data-source-validator-5cf8c89d64-w9c2k\" (UID: \"d81e70ae-22b0-4064-b389-fc9fa7c44924\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" May 28 14:54:49.242705 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.242689 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj8vq\" (UniqueName: \"kubernetes.io/projected/1189476e-9a0a-4bba-92e0-56a9e110a7e0-kube-api-access-gj8vq\") pod \"network-check-source-7f44b6dd87-8v9g6\" (UID: \"1189476e-9a0a-4bba-92e0-56a9e110a7e0\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" May 28 14:54:49.260277 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.260257 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx"] May 28 14:54:49.264121 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.264107 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.267150 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.267120 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 28 14:54:49.267240 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.267168 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 14:54:49.267240 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.267188 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 14:54:49.268411 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.268394 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9d4x9\"" May 28 14:54:49.268530 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.268467 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 28 14:54:49.272470 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.272452 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx"] May 28 14:54:49.334330 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334293 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-default-certificate\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.334425 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334342 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.334425 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334369 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3474f9e0-ce25-473b-b7e9-51882fcce751-tmp\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.334504 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334461 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3474f9e0-ce25-473b-b7e9-51882fcce751-service-ca-bundle\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.334504 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.334480 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 14:54:49.334599 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334512 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-stats-auth\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.334599 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.334542 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:49.834522108 +0000 UTC m=+137.801283864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : secret "router-metrics-certs-default" not found May 28 14:54:49.334599 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334573 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334601 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3474f9e0-ce25-473b-b7e9-51882fcce751-serving-cert\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334633 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msfpm\" (UniqueName: \"kubernetes.io/projected/3474f9e0-ce25-473b-b7e9-51882fcce751-kube-api-access-msfpm\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334659 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3474f9e0-ce25-473b-b7e9-51882fcce751-tmp\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334718 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3474f9e0-ce25-473b-b7e9-51882fcce751-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334746 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd65\" (UniqueName: \"kubernetes.io/projected/1f0f9c27-07d9-45ff-96eb-931940286665-kube-api-access-smd65\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klx6p\" (UniqueName: \"kubernetes.io/projected/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-kube-api-access-klx6p\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334811 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.334894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.334877 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3474f9e0-ce25-473b-b7e9-51882fcce751-snapshots\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.335341 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.335030 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:49.835014987 +0000 UTC m=+137.801776752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : configmap references non-existent config key: service-ca.crt May 28 14:54:49.335341 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.335074 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3474f9e0-ce25-473b-b7e9-51882fcce751-service-ca-bundle\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.335341 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.335101 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jshgq\" (UniqueName: \"kubernetes.io/projected/c511bf32-b677-4de5-af87-7ce1b0686870-kube-api-access-jshgq\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.335341 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.335166 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 14:54:49.335341 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.335237 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls podName:c511bf32-b677-4de5-af87-7ce1b0686870 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:49.835216804 +0000 UTC m=+137.801978567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls") pod "cluster-samples-operator-697587599-wtlbk" (UID: "c511bf32-b677-4de5-af87-7ce1b0686870") : secret "samples-operator-tls" not found May 28 14:54:49.335504 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.335452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3474f9e0-ce25-473b-b7e9-51882fcce751-snapshots\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.336021 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.336004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3474f9e0-ce25-473b-b7e9-51882fcce751-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.337167 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.337142 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-default-certificate\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.337250 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.337198 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-stats-auth\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.337289 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.337271 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3474f9e0-ce25-473b-b7e9-51882fcce751-serving-cert\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.343825 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.343804 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfpm\" (UniqueName: \"kubernetes.io/projected/3474f9e0-ce25-473b-b7e9-51882fcce751-kube-api-access-msfpm\") pod \"insights-operator-78bdfb888c-r4m86\" (UID: \"3474f9e0-ce25-473b-b7e9-51882fcce751\") " pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.344236 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.344212 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jshgq\" (UniqueName: \"kubernetes.io/projected/c511bf32-b677-4de5-af87-7ce1b0686870-kube-api-access-jshgq\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.344396 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.344380 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smd65\" (UniqueName: \"kubernetes.io/projected/1f0f9c27-07d9-45ff-96eb-931940286665-kube-api-access-smd65\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.367446 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.367413 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" May 28 14:54:49.374097 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.374080 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" May 28 14:54:49.379776 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.379667 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" May 28 14:54:49.436915 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.435813 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.436915 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.435858 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klx6p\" (UniqueName: \"kubernetes.io/projected/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-kube-api-access-klx6p\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.436915 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.435904 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.436915 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.436483 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 14:54:49.436915 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.436568 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls podName:69b10f97-38a2-4cd7-b9b1-b9f43d0ed481 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:49.936546176 +0000 UTC m=+137.903307936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mzfcx" (UID: "69b10f97-38a2-4cd7-b9b1-b9f43d0ed481") : secret "cluster-monitoring-operator-tls" not found May 28 14:54:49.437213 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.436972 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.446438 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.446383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klx6p\" (UniqueName: \"kubernetes.io/projected/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-kube-api-access-klx6p\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.474970 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.474884 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" May 28 14:54:49.505515 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.505461 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k"] May 28 14:54:49.509134 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:54:49.509084 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81e70ae_22b0_4064_b389_fc9fa7c44924.slice/crio-a8b7ab3a88560ce23b5ec9885cba944f8d02ef1b3d2521c73d015c111e22bb0f WatchSource:0}: Error finding container a8b7ab3a88560ce23b5ec9885cba944f8d02ef1b3d2521c73d015c111e22bb0f: Status 404 returned error can't find the container with id a8b7ab3a88560ce23b5ec9885cba944f8d02ef1b3d2521c73d015c111e22bb0f May 28 14:54:49.527521 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:54:49.527426 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1189476e_9a0a_4bba_92e0_56a9e110a7e0.slice/crio-ad643c98271bb74f38d5f910765bc18f620f9e1ba70d4d4caa4da379bbe4bce3 WatchSource:0}: Error finding container ad643c98271bb74f38d5f910765bc18f620f9e1ba70d4d4caa4da379bbe4bce3: Status 404 returned error can't find the container with id ad643c98271bb74f38d5f910765bc18f620f9e1ba70d4d4caa4da379bbe4bce3 May 28 14:54:49.535571 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.530484 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6"] May 28 14:54:49.546392 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.546349 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp"] May 28 14:54:49.550149 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:54:49.550117 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924b2db9_2aa0_4071_a020_93dda946a96a.slice/crio-72d5976cace7810169f08f6d9fceff06ff3ad2591062106cc90b3134d0748614 WatchSource:0}: Error finding container 72d5976cace7810169f08f6d9fceff06ff3ad2591062106cc90b3134d0748614: Status 404 returned error can't find the container with id 72d5976cace7810169f08f6d9fceff06ff3ad2591062106cc90b3134d0748614 May 28 14:54:49.616834 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.616766 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-r4m86"] May 28 14:54:49.620650 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:54:49.620616 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3474f9e0_ce25_473b_b7e9_51882fcce751.slice/crio-99de8d55c8870c6f4328e28dc35cd0fe7c53f8f4f9ef58092681ead3fa9d4ede WatchSource:0}: Error finding container 99de8d55c8870c6f4328e28dc35cd0fe7c53f8f4f9ef58092681ead3fa9d4ede: Status 404 returned error can't find the container with id 99de8d55c8870c6f4328e28dc35cd0fe7c53f8f4f9ef58092681ead3fa9d4ede May 28 14:54:49.839355 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.839251 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.839355 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.839348 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:49.839564 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.839444 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:50.839421695 +0000 UTC m=+138.806183449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : configmap references non-existent config key: service-ca.crt May 28 14:54:49.839564 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.839451 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 14:54:49.839564 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.839491 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls podName:c511bf32-b677-4de5-af87-7ce1b0686870 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:50.839480491 +0000 UTC m=+138.806242236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls") pod "cluster-samples-operator-697587599-wtlbk" (UID: "c511bf32-b677-4de5-af87-7ce1b0686870") : secret "samples-operator-tls" not found May 28 14:54:49.839710 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.839567 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:49.839710 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.839677 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 14:54:49.839791 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.839729 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:50.839714083 +0000 UTC m=+138.806475832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : secret "router-metrics-certs-default" not found May 28 14:54:49.940063 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.940025 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:49.940222 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.940154 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 14:54:49.940222 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:49.940210 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls podName:69b10f97-38a2-4cd7-b9b1-b9f43d0ed481 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:50.940196007 +0000 UTC m=+138.906957749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mzfcx" (UID: "69b10f97-38a2-4cd7-b9b1-b9f43d0ed481") : secret "cluster-monitoring-operator-tls" not found May 28 14:54:49.946607 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.946576 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" event={"ID":"1189476e-9a0a-4bba-92e0-56a9e110a7e0","Type":"ContainerStarted","Data":"a87d23fdd723a7a0c8a929c84c6b3593e97eb7b5cd27cee91a2b90a2a085cf8b"} May 28 14:54:49.946607 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.946611 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" event={"ID":"1189476e-9a0a-4bba-92e0-56a9e110a7e0","Type":"ContainerStarted","Data":"ad643c98271bb74f38d5f910765bc18f620f9e1ba70d4d4caa4da379bbe4bce3"} May 28 14:54:49.947602 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.947572 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" event={"ID":"3474f9e0-ce25-473b-b7e9-51882fcce751","Type":"ContainerStarted","Data":"99de8d55c8870c6f4328e28dc35cd0fe7c53f8f4f9ef58092681ead3fa9d4ede"} May 28 14:54:49.948613 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.948592 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" event={"ID":"924b2db9-2aa0-4071-a020-93dda946a96a","Type":"ContainerStarted","Data":"72d5976cace7810169f08f6d9fceff06ff3ad2591062106cc90b3134d0748614"} May 28 14:54:49.949568 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.949550 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" event={"ID":"d81e70ae-22b0-4064-b389-fc9fa7c44924","Type":"ContainerStarted","Data":"a8b7ab3a88560ce23b5ec9885cba944f8d02ef1b3d2521c73d015c111e22bb0f"} May 28 14:54:49.962994 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:49.962953 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8v9g6" podStartSLOduration=0.962942733 podStartE2EDuration="962.942733ms" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:54:49.961706101 +0000 UTC m=+137.928467865" watchObservedRunningTime="2026-05-28 14:54:49.962942733 +0000 UTC m=+137.929704533" May 28 14:54:50.848496 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:50.848360 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:50.848979 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.848539 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 14:54:50.848979 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.848616 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:52.848595272 +0000 UTC m=+140.815357028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : secret "router-metrics-certs-default" not found May 28 14:54:50.849118 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:50.848988 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:50.849118 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:50.849063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:50.849221 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.849196 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 14:54:50.849283 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.849241 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls podName:c511bf32-b677-4de5-af87-7ce1b0686870 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:52.849225527 +0000 UTC m=+140.815987289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls") pod "cluster-samples-operator-697587599-wtlbk" (UID: "c511bf32-b677-4de5-af87-7ce1b0686870") : secret "samples-operator-tls" not found May 28 14:54:50.849283 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.849264 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:52.849252685 +0000 UTC m=+140.816014435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : configmap references non-existent config key: service-ca.crt May 28 14:54:50.950566 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:50.950527 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:50.950724 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.950698 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 14:54:50.950803 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:50.950760 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls podName:69b10f97-38a2-4cd7-b9b1-b9f43d0ed481 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:52.950745674 +0000 UTC m=+140.917507434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mzfcx" (UID: "69b10f97-38a2-4cd7-b9b1-b9f43d0ed481") : secret "cluster-monitoring-operator-tls" not found May 28 14:54:51.955394 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:51.955350 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" event={"ID":"d81e70ae-22b0-4064-b389-fc9fa7c44924","Type":"ContainerStarted","Data":"a8fca407ee818d788b55d3534e4384caea71d067f4ff1e34e6616e92d91227ef"} May 28 14:54:51.974434 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:51.974388 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w9c2k" podStartSLOduration=1.335407531 podStartE2EDuration="2.974371465s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:54:49.511454051 +0000 UTC m=+137.478215795" lastFinishedPulling="2026-05-28 14:54:51.150417982 +0000 UTC m=+139.117179729" observedRunningTime="2026-05-28 14:54:51.973977159 +0000 UTC m=+139.940738925" watchObservedRunningTime="2026-05-28 14:54:51.974371465 +0000 UTC m=+139.941133233" May 28 14:54:52.867283 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.867246 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:52.867483 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.867348 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:52.867483 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.867404 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:52.867483 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.867425 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 14:54:52.867483 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.867478 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:56.867464219 +0000 UTC m=+144.834225962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : secret "router-metrics-certs-default" not found May 28 14:54:52.867669 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.867492 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 14:54:52.867669 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.867515 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:56.867497379 +0000 UTC m=+144.834259130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : configmap references non-existent config key: service-ca.crt May 28 14:54:52.867669 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.867597 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls podName:c511bf32-b677-4de5-af87-7ce1b0686870 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:56.867586779 +0000 UTC m=+144.834348527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls") pod "cluster-samples-operator-697587599-wtlbk" (UID: "c511bf32-b677-4de5-af87-7ce1b0686870") : secret "samples-operator-tls" not found May 28 14:54:52.959078 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.959037 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" event={"ID":"3474f9e0-ce25-473b-b7e9-51882fcce751","Type":"ContainerStarted","Data":"ade2e857eaebde3b7ecbbfbd396d2fcd1b5176320be8647dcce05a2de88e35ae"} May 28 14:54:52.960559 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.960524 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" event={"ID":"924b2db9-2aa0-4071-a020-93dda946a96a","Type":"ContainerStarted","Data":"e15a7dbec105d16967a4e7e4b51ec7d6201e416055acdd67028bc4e16396523e"} May 28 14:54:52.968606 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.968534 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:52.968839 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.968819 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 14:54:52.968926 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:52.968888 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls podName:69b10f97-38a2-4cd7-b9b1-b9f43d0ed481 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:56.968870721 +0000 UTC m=+144.935632468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mzfcx" (UID: "69b10f97-38a2-4cd7-b9b1-b9f43d0ed481") : secret "cluster-monitoring-operator-tls" not found May 28 14:54:52.976604 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.976561 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" podStartSLOduration=1.375145042 podStartE2EDuration="3.976547351s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:54:49.622500833 +0000 UTC m=+137.589262576" lastFinishedPulling="2026-05-28 14:54:52.223903136 +0000 UTC m=+140.190664885" observedRunningTime="2026-05-28 14:54:52.975695136 +0000 UTC m=+140.942456904" watchObservedRunningTime="2026-05-28 14:54:52.976547351 +0000 UTC m=+140.943309118" May 28 14:54:52.990652 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:52.990611 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" podStartSLOduration=1.320656071 podStartE2EDuration="3.990600096s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:54:49.551801075 +0000 UTC m=+137.518562817" lastFinishedPulling="2026-05-28 14:54:52.221745099 +0000 UTC m=+140.188506842" observedRunningTime="2026-05-28 14:54:52.990155947 +0000 UTC m=+140.956917713" watchObservedRunningTime="2026-05-28 14:54:52.990600096 +0000 UTC m=+140.957361860" May 28 14:54:53.367817 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.367782 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw"] May 28 14:54:53.370991 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.370963 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" May 28 14:54:53.373662 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.373638 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 28 14:54:53.373809 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.373788 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s8mcp\"" May 28 14:54:53.373860 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.373825 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 28 14:54:53.379794 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.379773 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw"] May 28 14:54:53.472135 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.472096 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lv8b\" (UniqueName: \"kubernetes.io/projected/3b5284ee-5988-4f92-86a3-3aa4135c10d0-kube-api-access-8lv8b\") pod \"migrator-b985f5d89-gl7sw\" (UID: \"3b5284ee-5988-4f92-86a3-3aa4135c10d0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" May 28 14:54:53.572888 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.572854 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lv8b\" (UniqueName: \"kubernetes.io/projected/3b5284ee-5988-4f92-86a3-3aa4135c10d0-kube-api-access-8lv8b\") pod \"migrator-b985f5d89-gl7sw\" (UID: \"3b5284ee-5988-4f92-86a3-3aa4135c10d0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" May 28 14:54:53.581916 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.581881 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lv8b\" (UniqueName: \"kubernetes.io/projected/3b5284ee-5988-4f92-86a3-3aa4135c10d0-kube-api-access-8lv8b\") pod \"migrator-b985f5d89-gl7sw\" (UID: \"3b5284ee-5988-4f92-86a3-3aa4135c10d0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" May 28 14:54:53.680973 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.680907 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" May 28 14:54:53.803030 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.802997 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw"] May 28 14:54:53.806164 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:54:53.806138 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5284ee_5988_4f92_86a3_3aa4135c10d0.slice/crio-952af4f5daa1a125a7378ef4e66277f64b7feb2dbb44302e27e90076bdf1c12e WatchSource:0}: Error finding container 952af4f5daa1a125a7378ef4e66277f64b7feb2dbb44302e27e90076bdf1c12e: Status 404 returned error can't find the container with id 952af4f5daa1a125a7378ef4e66277f64b7feb2dbb44302e27e90076bdf1c12e May 28 14:54:53.965533 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:53.965418 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" event={"ID":"3b5284ee-5988-4f92-86a3-3aa4135c10d0","Type":"ContainerStarted","Data":"952af4f5daa1a125a7378ef4e66277f64b7feb2dbb44302e27e90076bdf1c12e"} May 28 14:54:55.971742 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:55.971710 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" event={"ID":"3b5284ee-5988-4f92-86a3-3aa4135c10d0","Type":"ContainerStarted","Data":"aa31936b4ca44b7ca00858222480ab88cd3bdd96e8b049044ac6d37ffe784006"} May 28 14:54:55.972126 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:55.971743 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" event={"ID":"3b5284ee-5988-4f92-86a3-3aa4135c10d0","Type":"ContainerStarted","Data":"c65d7cbaf36d94e252a46cc419ac11c54743e00f4d002f246d0d2673d4856a3a"} May 28 14:54:55.989074 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:55.989030 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-gl7sw" podStartSLOduration=1.777251579 podStartE2EDuration="2.98901806s" podCreationTimestamp="2026-05-28 14:54:53 +0000 UTC" firstStartedPulling="2026-05-28 14:54:53.808018282 +0000 UTC m=+141.774780025" lastFinishedPulling="2026-05-28 14:54:55.01978476 +0000 UTC m=+142.986546506" observedRunningTime="2026-05-28 14:54:55.987945895 +0000 UTC m=+143.954707661" watchObservedRunningTime="2026-05-28 14:54:55.98901806 +0000 UTC m=+143.955779825" May 28 14:54:56.578614 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:56.578590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9xjw2_362fcd77-1677-4840-830d-b27bf923a874/dns-node-resolver/0.log" May 28 14:54:56.902296 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:56.902201 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:56.902296 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:56.902285 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:54:56.902530 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:56.902354 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:54:56.902530 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:56.902369 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 14:54:56.902530 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:56.902433 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:04.902414158 +0000 UTC m=+152.869175902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : secret "router-metrics-certs-default" not found May 28 14:54:56.902530 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:56.902447 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle podName:1f0f9c27-07d9-45ff-96eb-931940286665 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:04.902441253 +0000 UTC m=+152.869202995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle") pod "router-default-6569d6554b-xnz6j" (UID: "1f0f9c27-07d9-45ff-96eb-931940286665") : configmap references non-existent config key: service-ca.crt May 28 14:54:56.902530 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:56.902491 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 14:54:56.902712 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:56.902552 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls podName:c511bf32-b677-4de5-af87-7ce1b0686870 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:04.902534367 +0000 UTC m=+152.869296125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls") pod "cluster-samples-operator-697587599-wtlbk" (UID: "c511bf32-b677-4de5-af87-7ce1b0686870") : secret "samples-operator-tls" not found May 28 14:54:57.003429 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:57.003399 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:54:57.003778 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:57.003518 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 14:54:57.003778 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:54:57.003571 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls podName:69b10f97-38a2-4cd7-b9b1-b9f43d0ed481 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:05.003556694 +0000 UTC m=+152.970318442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mzfcx" (UID: "69b10f97-38a2-4cd7-b9b1-b9f43d0ed481") : secret "cluster-monitoring-operator-tls" not found May 28 14:54:57.778119 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:57.778092 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98jws_7b178de4-ff32-4f71-ace9-fd0ae3e26280/node-ca/0.log" May 28 14:54:58.978434 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:58.978405 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-gl7sw_3b5284ee-5988-4f92-86a3-3aa4135c10d0/migrator/0.log" May 28 14:54:59.177095 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:59.177065 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-gl7sw_3b5284ee-5988-4f92-86a3-3aa4135c10d0/graceful-termination/0.log" May 28 14:54:59.388556 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:54:59.388524 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-bpxpp_924b2db9-2aa0-4071-a020-93dda946a96a/kube-storage-version-migrator-operator/0.log" May 28 14:55:04.972815 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:04.972772 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:04.973214 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:04.972854 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:55:04.973214 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:04.973028 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:04.973419 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:04.973398 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0f9c27-07d9-45ff-96eb-931940286665-service-ca-bundle\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:04.975469 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:04.975445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c511bf32-b677-4de5-af87-7ce1b0686870-samples-operator-tls\") pod \"cluster-samples-operator-697587599-wtlbk\" (UID: \"c511bf32-b677-4de5-af87-7ce1b0686870\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:55:04.975519 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:04.975480 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f9c27-07d9-45ff-96eb-931940286665-metrics-certs\") pod \"router-default-6569d6554b-xnz6j\" (UID: \"1f0f9c27-07d9-45ff-96eb-931940286665\") " pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:05.067188 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.067147 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" May 28 14:55:05.074195 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.074171 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:55:05.074318 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:05.074288 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 14:55:05.074371 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:05.074350 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls podName:69b10f97-38a2-4cd7-b9b1-b9f43d0ed481 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:21.074335675 +0000 UTC m=+169.041097423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mzfcx" (UID: "69b10f97-38a2-4cd7-b9b1-b9f43d0ed481") : secret "cluster-monitoring-operator-tls" not found May 28 14:55:05.081235 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.081206 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:05.194245 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.194220 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk"] May 28 14:55:05.211427 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.211343 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6569d6554b-xnz6j"] May 28 14:55:05.214174 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:05.214150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0f9c27_07d9_45ff_96eb_931940286665.slice/crio-17c1d0852e073f078918e8a2d9792e318b74da6987816b1d90b9e1964d9d636c WatchSource:0}: Error finding container 17c1d0852e073f078918e8a2d9792e318b74da6987816b1d90b9e1964d9d636c: Status 404 returned error can't find the container with id 17c1d0852e073f078918e8a2d9792e318b74da6987816b1d90b9e1964d9d636c May 28 14:55:05.997636 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.997599 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" event={"ID":"c511bf32-b677-4de5-af87-7ce1b0686870","Type":"ContainerStarted","Data":"9b2416d02faf6161733584a3dbe2b7803f5eb239026e5c1acc9120e356b5cd96"} May 28 14:55:05.998988 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.998961 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6569d6554b-xnz6j" event={"ID":"1f0f9c27-07d9-45ff-96eb-931940286665","Type":"ContainerStarted","Data":"9f3ab456fdb10696ffc9e5da847489ef8bc375b8292a2f5a3dbfaf5838b0fbed"} May 28 14:55:05.998988 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:05.998991 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6569d6554b-xnz6j" event={"ID":"1f0f9c27-07d9-45ff-96eb-931940286665","Type":"ContainerStarted","Data":"17c1d0852e073f078918e8a2d9792e318b74da6987816b1d90b9e1964d9d636c"} May 28 14:55:06.017572 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:06.017523 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6569d6554b-xnz6j" podStartSLOduration=17.01750767 podStartE2EDuration="17.01750767s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:55:06.017393133 +0000 UTC m=+153.984154904" watchObservedRunningTime="2026-05-28 14:55:06.01750767 +0000 UTC m=+153.984269429" May 28 14:55:06.081638 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:06.081608 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:06.084330 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:06.084292 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:07.002131 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:07.002096 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:07.003522 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:07.003503 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6569d6554b-xnz6j" May 28 14:55:08.005956 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:08.005921 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" event={"ID":"c511bf32-b677-4de5-af87-7ce1b0686870","Type":"ContainerStarted","Data":"7a9d4a0bf3d2d1ed00972e47fb66a90268d3c8d94171b38055c398ce144e18a5"} May 28 14:55:08.005956 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:08.005959 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" event={"ID":"c511bf32-b677-4de5-af87-7ce1b0686870","Type":"ContainerStarted","Data":"56d8006d7fff6c8f4e457496ffdeb1d684be4c1023395759ea5df50967b68293"} May 28 14:55:08.025298 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:08.025255 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-wtlbk" podStartSLOduration=17.002919803 podStartE2EDuration="19.025242461s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:55:05.247476614 +0000 UTC m=+153.214238357" lastFinishedPulling="2026-05-28 14:55:07.269799268 +0000 UTC m=+155.236561015" observedRunningTime="2026-05-28 14:55:08.023615713 +0000 UTC m=+155.990377478" watchObservedRunningTime="2026-05-28 14:55:08.025242461 +0000 UTC m=+155.992004224" May 28 14:55:10.363019 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:10.362964 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67648996fb-xr64t" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" May 28 14:55:10.373094 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:10.373064 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-4m795" podUID="d0c535af-3f69-47c1-8395-c245d1726748" May 28 14:55:10.469226 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:10.469190 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x2xxq" podUID="1d5c5c98-be38-4857-9844-ab5321c762b5" May 28 14:55:11.013063 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:11.013027 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2xxq" May 28 14:55:11.013063 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:11.013061 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:55:11.013250 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:11.013089 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:55:11.661391 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:11.661340 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qbj7c" podUID="966e40a6-12aa-4008-af5e-79ad1884aa83" May 28 14:55:15.356354 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.356303 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:55:15.356820 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.356391 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:55:15.358822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.358796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"image-registry-67648996fb-xr64t\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:55:15.358942 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.358796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c535af-3f69-47c1-8395-c245d1726748-cert\") pod \"ingress-canary-4m795\" (UID: \"d0c535af-3f69-47c1-8395-c245d1726748\") " pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:55:15.457379 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.457354 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:55:15.459431 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.459412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d5c5c98-be38-4857-9844-ab5321c762b5-metrics-tls\") pod \"dns-default-x2xxq\" (UID: \"1d5c5c98-be38-4857-9844-ab5321c762b5\") " pod="openshift-dns/dns-default-x2xxq" May 28 14:55:15.517623 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.517593 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbq8w\"" May 28 14:55:15.517623 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.517593 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqk5j\"" May 28 14:55:15.517805 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.517603 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znwr4\"" May 28 14:55:15.524977 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.524958 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4m795" May 28 14:55:15.525027 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.524980 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2xxq" May 28 14:55:15.525090 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.525071 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:55:15.665836 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.665797 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4m795"] May 28 14:55:15.668652 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:15.668624 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c535af_3f69_47c1_8395_c245d1726748.slice/crio-36cc505ad2b7aeb67a33dffa2b3f614bfa9944cd35ccd839f2cb5a873b02146b WatchSource:0}: Error finding container 36cc505ad2b7aeb67a33dffa2b3f614bfa9944cd35ccd839f2cb5a873b02146b: Status 404 returned error can't find the container with id 36cc505ad2b7aeb67a33dffa2b3f614bfa9944cd35ccd839f2cb5a873b02146b May 28 14:55:15.889210 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.889140 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2xxq"] May 28 14:55:15.891652 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:15.891483 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67648996fb-xr64t"] May 28 14:55:15.892443 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:15.892419 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5c5c98_be38_4857_9844_ab5321c762b5.slice/crio-f07365bcea80f12c394837c90b08092cc8a1e9911e8f4e843cf129d8742b6db3 WatchSource:0}: Error finding container f07365bcea80f12c394837c90b08092cc8a1e9911e8f4e843cf129d8742b6db3: Status 404 returned error can't find the container with id f07365bcea80f12c394837c90b08092cc8a1e9911e8f4e843cf129d8742b6db3 May 28 14:55:15.893304 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:15.893282 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea536094_e4d0_4dc1_a014_7692c35b9917.slice/crio-863592b19185941100f392cbb62548490ac3110cbbdb5bdb83942002d9dfe2ae WatchSource:0}: Error finding container 863592b19185941100f392cbb62548490ac3110cbbdb5bdb83942002d9dfe2ae: Status 404 returned error can't find the container with id 863592b19185941100f392cbb62548490ac3110cbbdb5bdb83942002d9dfe2ae May 28 14:55:16.027536 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:16.027497 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2xxq" event={"ID":"1d5c5c98-be38-4857-9844-ab5321c762b5","Type":"ContainerStarted","Data":"f07365bcea80f12c394837c90b08092cc8a1e9911e8f4e843cf129d8742b6db3"} May 28 14:55:16.028460 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:16.028423 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4m795" event={"ID":"d0c535af-3f69-47c1-8395-c245d1726748","Type":"ContainerStarted","Data":"36cc505ad2b7aeb67a33dffa2b3f614bfa9944cd35ccd839f2cb5a873b02146b"} May 28 14:55:16.029648 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:16.029627 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67648996fb-xr64t" event={"ID":"ea536094-e4d0-4dc1-a014-7692c35b9917","Type":"ContainerStarted","Data":"9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e"} May 28 14:55:16.029720 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:16.029652 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67648996fb-xr64t" event={"ID":"ea536094-e4d0-4dc1-a014-7692c35b9917","Type":"ContainerStarted","Data":"863592b19185941100f392cbb62548490ac3110cbbdb5bdb83942002d9dfe2ae"} May 28 14:55:16.029787 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:16.029767 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:55:16.048571 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:16.048520 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67648996fb-xr64t" podStartSLOduration=163.048502835 podStartE2EDuration="2m43.048502835s" podCreationTimestamp="2026-05-28 14:52:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:55:16.047058787 +0000 UTC m=+164.013820553" watchObservedRunningTime="2026-05-28 14:55:16.048502835 +0000 UTC m=+164.015264604" May 28 14:55:18.038029 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:18.037991 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2xxq" event={"ID":"1d5c5c98-be38-4857-9844-ab5321c762b5","Type":"ContainerStarted","Data":"22d42603529c951a222d9f60272c45676085b14f19314b32bf3de82748bf0f7b"} May 28 14:55:18.038029 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:18.038031 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2xxq" event={"ID":"1d5c5c98-be38-4857-9844-ab5321c762b5","Type":"ContainerStarted","Data":"39d0060ea13bf27395228f8f8f4beed116c848b9d9e0071be99d55fd37f4db01"} May 28 14:55:18.038527 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:18.038141 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x2xxq" May 28 14:55:18.039387 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:18.039368 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4m795" event={"ID":"d0c535af-3f69-47c1-8395-c245d1726748","Type":"ContainerStarted","Data":"cc30362e989f1f2f70ebf1f94a36cccf29fe22f11df3f05440827a408fbd55a3"} May 28 14:55:18.054050 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:18.053965 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-x2xxq" podStartSLOduration=129.150917099 podStartE2EDuration="2m11.053955518s" podCreationTimestamp="2026-05-28 14:53:07 +0000 UTC" firstStartedPulling="2026-05-28 14:55:15.89437629 +0000 UTC m=+163.861138033" lastFinishedPulling="2026-05-28 14:55:17.797414696 +0000 UTC m=+165.764176452" observedRunningTime="2026-05-28 14:55:18.053709549 +0000 UTC m=+166.020471313" watchObservedRunningTime="2026-05-28 14:55:18.053955518 +0000 UTC m=+166.020717277" May 28 14:55:18.069760 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:18.069718 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4m795" podStartSLOduration=128.93976415 podStartE2EDuration="2m11.069707885s" podCreationTimestamp="2026-05-28 14:53:07 +0000 UTC" firstStartedPulling="2026-05-28 14:55:15.670643818 +0000 UTC m=+163.637405564" lastFinishedPulling="2026-05-28 14:55:17.800587556 +0000 UTC m=+165.767349299" observedRunningTime="2026-05-28 14:55:18.068759846 +0000 UTC m=+166.035521610" watchObservedRunningTime="2026-05-28 14:55:18.069707885 +0000 UTC m=+166.036469651" May 28 14:55:19.688836 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.688806 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ct7gm"] May 28 14:55:19.692497 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.692474 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.695179 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.695162 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4jwb\"" May 28 14:55:19.696131 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.696114 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 14:55:19.696195 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.696116 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 14:55:19.710375 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.710354 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ct7gm"] May 28 14:55:19.794022 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.793987 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f59c8292-8dc2-49c6-85c7-f325ce46ab16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.794022 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.794025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvw4\" (UniqueName: \"kubernetes.io/projected/f59c8292-8dc2-49c6-85c7-f325ce46ab16-kube-api-access-gmvw4\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.794229 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.794119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f59c8292-8dc2-49c6-85c7-f325ce46ab16-data-volume\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.794229 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.794193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f59c8292-8dc2-49c6-85c7-f325ce46ab16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.794229 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.794214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f59c8292-8dc2-49c6-85c7-f325ce46ab16-crio-socket\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895513 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895414 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f59c8292-8dc2-49c6-85c7-f325ce46ab16-data-volume\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895513 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895487 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f59c8292-8dc2-49c6-85c7-f325ce46ab16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895513 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895508 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f59c8292-8dc2-49c6-85c7-f325ce46ab16-crio-socket\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895791 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f59c8292-8dc2-49c6-85c7-f325ce46ab16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895791 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895541 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvw4\" (UniqueName: \"kubernetes.io/projected/f59c8292-8dc2-49c6-85c7-f325ce46ab16-kube-api-access-gmvw4\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895791 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895627 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f59c8292-8dc2-49c6-85c7-f325ce46ab16-crio-socket\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.895931 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.895841 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f59c8292-8dc2-49c6-85c7-f325ce46ab16-data-volume\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.896071 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.896054 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f59c8292-8dc2-49c6-85c7-f325ce46ab16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.897947 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.897931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f59c8292-8dc2-49c6-85c7-f325ce46ab16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:19.903690 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:19.903666 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvw4\" (UniqueName: \"kubernetes.io/projected/f59c8292-8dc2-49c6-85c7-f325ce46ab16-kube-api-access-gmvw4\") pod \"insights-runtime-extractor-ct7gm\" (UID: \"f59c8292-8dc2-49c6-85c7-f325ce46ab16\") " pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:20.001531 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:20.001496 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ct7gm" May 28 14:55:20.122327 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:20.122284 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ct7gm"] May 28 14:55:20.125592 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:20.125566 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59c8292_8dc2_49c6_85c7_f325ce46ab16.slice/crio-b98dc999420e7054c53ddebc9aa66b3845ae0bf2edbdb8a37aacd44cd938e280 WatchSource:0}: Error finding container b98dc999420e7054c53ddebc9aa66b3845ae0bf2edbdb8a37aacd44cd938e280: Status 404 returned error can't find the container with id b98dc999420e7054c53ddebc9aa66b3845ae0bf2edbdb8a37aacd44cd938e280 May 28 14:55:21.048277 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:21.048239 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct7gm" event={"ID":"f59c8292-8dc2-49c6-85c7-f325ce46ab16","Type":"ContainerStarted","Data":"7457afe040c40529c7c1ec7ed3aeaaef9d8c3ada771d274368d58842fcdbfe56"} May 28 14:55:21.048277 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:21.048281 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct7gm" event={"ID":"f59c8292-8dc2-49c6-85c7-f325ce46ab16","Type":"ContainerStarted","Data":"b98dc999420e7054c53ddebc9aa66b3845ae0bf2edbdb8a37aacd44cd938e280"} May 28 14:55:21.104512 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:21.104488 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:55:21.106761 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:21.106740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69b10f97-38a2-4cd7-b9b1-b9f43d0ed481-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mzfcx\" (UID: \"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:55:21.373067 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:21.373032 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" May 28 14:55:21.490803 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:21.490773 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx"] May 28 14:55:21.493279 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:21.493250 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b10f97_38a2_4cd7_b9b1_b9f43d0ed481.slice/crio-1ceb33356efe5d2b4f314b4b2881d3d7d2701b0dbab42f12e1e1d1e5e531805d WatchSource:0}: Error finding container 1ceb33356efe5d2b4f314b4b2881d3d7d2701b0dbab42f12e1e1d1e5e531805d: Status 404 returned error can't find the container with id 1ceb33356efe5d2b4f314b4b2881d3d7d2701b0dbab42f12e1e1d1e5e531805d May 28 14:55:22.054138 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:22.054093 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct7gm" event={"ID":"f59c8292-8dc2-49c6-85c7-f325ce46ab16","Type":"ContainerStarted","Data":"4fe1ed7d33fcfb6413e3e4b27cce09eb438d18b151daa5e0f6858e8a184bb524"} May 28 14:55:22.055269 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:22.055246 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" event={"ID":"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481","Type":"ContainerStarted","Data":"1ceb33356efe5d2b4f314b4b2881d3d7d2701b0dbab42f12e1e1d1e5e531805d"} May 28 14:55:23.059700 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.059658 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct7gm" event={"ID":"f59c8292-8dc2-49c6-85c7-f325ce46ab16","Type":"ContainerStarted","Data":"24f8542ec904c53b2cf50f3e1e1969e24a294781aeb881f493f4400701a8b06d"} May 28 14:55:23.077055 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.077006 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ct7gm" podStartSLOduration=1.746183717 podStartE2EDuration="4.076991299s" podCreationTimestamp="2026-05-28 14:55:19 +0000 UTC" firstStartedPulling="2026-05-28 14:55:20.183711933 +0000 UTC m=+168.150473688" lastFinishedPulling="2026-05-28 14:55:22.514519524 +0000 UTC m=+170.481281270" observedRunningTime="2026-05-28 14:55:23.075967961 +0000 UTC m=+171.042729726" watchObservedRunningTime="2026-05-28 14:55:23.076991299 +0000 UTC m=+171.043753107" May 28 14:55:23.974952 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.974918 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9"] May 28 14:55:23.976794 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.976777 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:23.979214 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.979194 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 28 14:55:23.979335 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.979234 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-c8kwc\"" May 28 14:55:23.986964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:23.986943 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9"] May 28 14:55:24.063893 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.063869 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" event={"ID":"69b10f97-38a2-4cd7-b9b1-b9f43d0ed481","Type":"ContainerStarted","Data":"3174c67298e10f0d906c9de7ba6429b850cc69acd4cb9f2f506f12cf096fe91e"} May 28 14:55:24.082152 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.082110 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mzfcx" podStartSLOduration=33.077664433 podStartE2EDuration="35.082096609s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:55:21.49509163 +0000 UTC m=+169.461853376" lastFinishedPulling="2026-05-28 14:55:23.499523788 +0000 UTC m=+171.466285552" observedRunningTime="2026-05-28 14:55:24.081195847 +0000 UTC m=+172.047957646" watchObservedRunningTime="2026-05-28 14:55:24.082096609 +0000 UTC m=+172.048858374" May 28 14:55:24.133451 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.133418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/64120d4f-afa2-404d-bc3e-e14d09cd8d8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-f89x9\" (UID: \"64120d4f-afa2-404d-bc3e-e14d09cd8d8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:24.234914 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.234826 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/64120d4f-afa2-404d-bc3e-e14d09cd8d8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-f89x9\" (UID: \"64120d4f-afa2-404d-bc3e-e14d09cd8d8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:24.237477 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.237453 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/64120d4f-afa2-404d-bc3e-e14d09cd8d8a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-f89x9\" (UID: \"64120d4f-afa2-404d-bc3e-e14d09cd8d8a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:24.285157 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.285132 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:24.420090 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:24.420062 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9"] May 28 14:55:24.421176 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:24.421150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64120d4f_afa2_404d_bc3e_e14d09cd8d8a.slice/crio-9880ef6c922b18fcbfb4e07cf1e147abbdbd54f9cc74eb17deeee95e428a9145 WatchSource:0}: Error finding container 9880ef6c922b18fcbfb4e07cf1e147abbdbd54f9cc74eb17deeee95e428a9145: Status 404 returned error can't find the container with id 9880ef6c922b18fcbfb4e07cf1e147abbdbd54f9cc74eb17deeee95e428a9145 May 28 14:55:25.068139 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:25.068105 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" event={"ID":"64120d4f-afa2-404d-bc3e-e14d09cd8d8a","Type":"ContainerStarted","Data":"9880ef6c922b18fcbfb4e07cf1e147abbdbd54f9cc74eb17deeee95e428a9145"} May 28 14:55:25.635206 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:25.635176 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:55:26.072231 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:26.072192 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" event={"ID":"64120d4f-afa2-404d-bc3e-e14d09cd8d8a","Type":"ContainerStarted","Data":"84987878cc3fce24fec7cda586093dcc9d3f76f8e66b0177fa91deeab6cd7f45"} May 28 14:55:26.072681 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:26.072442 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:26.077019 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:26.076997 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" May 28 14:55:26.090599 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:26.090561 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-f89x9" podStartSLOduration=2.10312559 podStartE2EDuration="3.090549524s" podCreationTimestamp="2026-05-28 14:55:23 +0000 UTC" firstStartedPulling="2026-05-28 14:55:24.423163327 +0000 UTC m=+172.389925077" lastFinishedPulling="2026-05-28 14:55:25.410587263 +0000 UTC m=+173.377349011" observedRunningTime="2026-05-28 14:55:26.089692417 +0000 UTC m=+174.056454184" watchObservedRunningTime="2026-05-28 14:55:26.090549524 +0000 UTC m=+174.057311305" May 28 14:55:28.043739 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:28.043711 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x2xxq" May 28 14:55:31.378894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.378853 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-th57l"] May 28 14:55:31.382224 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.382200 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.384787 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.384765 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 14:55:31.384924 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.384871 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 14:55:31.385781 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.385764 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 14:55:31.385880 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.385785 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mw2v6\"" May 28 14:55:31.386114 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.386096 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 14:55:31.493273 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10338103-c5eb-480b-b58a-86d8b1c9d28a-metrics-client-ca\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493433 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493281 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-textfile\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493433 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493433 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493359 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4ll\" (UniqueName: \"kubernetes.io/projected/10338103-c5eb-480b-b58a-86d8b1c9d28a-kube-api-access-ln4ll\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493551 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-accelerators-collector-config\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493551 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493456 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-tls\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493551 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-root\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493551 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493499 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-sys\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.493551 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.493532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-wtmp\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.594718 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594686 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-wtmp\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.594871 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594722 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10338103-c5eb-480b-b58a-86d8b1c9d28a-metrics-client-ca\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.594871 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594752 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-textfile\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.594871 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594783 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.594871 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594807 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4ll\" (UniqueName: \"kubernetes.io/projected/10338103-c5eb-480b-b58a-86d8b1c9d28a-kube-api-access-ln4ll\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595070 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594874 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-accelerators-collector-config\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595070 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-wtmp\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595070 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594906 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-tls\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595070 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594957 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-root\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595070 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.594981 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-sys\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595070 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:31.595060 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 14:55:31.595399 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:31.595125 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-tls podName:10338103-c5eb-480b-b58a-86d8b1c9d28a nodeName:}" failed. No retries permitted until 2026-05-28 14:55:32.095105612 +0000 UTC m=+180.061867368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-tls") pod "node-exporter-th57l" (UID: "10338103-c5eb-480b-b58a-86d8b1c9d28a") : secret "node-exporter-tls" not found May 28 14:55:31.595399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.595059 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-sys\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.595134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10338103-c5eb-480b-b58a-86d8b1c9d28a-root\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595399 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.595210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-textfile\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595592 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.595504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-accelerators-collector-config\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.595689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.595671 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10338103-c5eb-480b-b58a-86d8b1c9d28a-metrics-client-ca\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.597169 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.597146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:31.605161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:31.605134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4ll\" (UniqueName: \"kubernetes.io/projected/10338103-c5eb-480b-b58a-86d8b1c9d28a-kube-api-access-ln4ll\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:32.099755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:32.099723 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-tls\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:32.101945 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:32.101923 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10338103-c5eb-480b-b58a-86d8b1c9d28a-node-exporter-tls\") pod \"node-exporter-th57l\" (UID: \"10338103-c5eb-480b-b58a-86d8b1c9d28a\") " pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:32.291724 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:32.291693 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-th57l" May 28 14:55:32.301054 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:32.301028 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10338103_c5eb_480b_b58a_86d8b1c9d28a.slice/crio-d736bb107bc6cfc4e08da44668553385654c9508bb9fab6ebb576802f26dbc72 WatchSource:0}: Error finding container d736bb107bc6cfc4e08da44668553385654c9508bb9fab6ebb576802f26dbc72: Status 404 returned error can't find the container with id d736bb107bc6cfc4e08da44668553385654c9508bb9fab6ebb576802f26dbc72 May 28 14:55:33.097431 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:33.097388 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-th57l" event={"ID":"10338103-c5eb-480b-b58a-86d8b1c9d28a","Type":"ContainerStarted","Data":"d736bb107bc6cfc4e08da44668553385654c9508bb9fab6ebb576802f26dbc72"} May 28 14:55:34.101984 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.101953 2555 generic.go:358] "Generic (PLEG): container finished" podID="10338103-c5eb-480b-b58a-86d8b1c9d28a" containerID="a74004d58719a0ee720cfbc02ec4c3356539c1fcf86fbf317665b74f16071b5e" exitCode=0 May 28 14:55:34.102430 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.102006 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-th57l" event={"ID":"10338103-c5eb-480b-b58a-86d8b1c9d28a","Type":"ContainerDied","Data":"a74004d58719a0ee720cfbc02ec4c3356539c1fcf86fbf317665b74f16071b5e"} May 28 14:55:34.354891 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.354803 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b766ff6cc-xp4vp"] May 28 14:55:34.357433 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.357417 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.359944 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.359919 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 28 14:55:34.360105 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.360029 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 28 14:55:34.360105 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.360041 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-73al4lpsk4e7i\"" May 28 14:55:34.360105 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.360050 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 28 14:55:34.360273 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.360154 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 28 14:55:34.360273 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.360187 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 28 14:55:34.360386 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.360339 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-657zg\"" May 28 14:55:34.369820 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.369799 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b766ff6cc-xp4vp"] May 28 14:55:34.519484 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-metrics-client-ca\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519658 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-grpc-tls\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519658 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519658 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdfv9\" (UniqueName: \"kubernetes.io/projected/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-kube-api-access-qdfv9\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519658 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519658 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519651 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519811 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-tls\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.519811 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.519713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620422 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620331 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-tls\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620422 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620386 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620638 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620440 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-metrics-client-ca\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620638 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-grpc-tls\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620638 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620499 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620638 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620536 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdfv9\" (UniqueName: \"kubernetes.io/projected/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-kube-api-access-qdfv9\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620811 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620692 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.620811 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.620737 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.621373 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.621346 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-metrics-client-ca\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.623346 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.623276 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.623472 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.623437 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-grpc-tls\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.623693 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.623673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.623731 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.623685 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-tls\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.623731 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.623711 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.623793 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.623737 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.627443 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.627425 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdfv9\" (UniqueName: \"kubernetes.io/projected/3ccc0b65-d4fd-4aac-91f6-7f174affb4fe-kube-api-access-qdfv9\") pod \"thanos-querier-b766ff6cc-xp4vp\" (UID: \"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe\") " pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.666646 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.666620 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:34.796694 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:34.796664 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b766ff6cc-xp4vp"] May 28 14:55:34.800073 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:34.800040 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccc0b65_d4fd_4aac_91f6_7f174affb4fe.slice/crio-b1efa66e003ef16db83dd03b4f392e6356e56df791db31bf5a70cec6bf00a063 WatchSource:0}: Error finding container b1efa66e003ef16db83dd03b4f392e6356e56df791db31bf5a70cec6bf00a063: Status 404 returned error can't find the container with id b1efa66e003ef16db83dd03b4f392e6356e56df791db31bf5a70cec6bf00a063 May 28 14:55:35.105024 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.104993 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"b1efa66e003ef16db83dd03b4f392e6356e56df791db31bf5a70cec6bf00a063"} May 28 14:55:35.106686 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.106663 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-th57l" event={"ID":"10338103-c5eb-480b-b58a-86d8b1c9d28a","Type":"ContainerStarted","Data":"b4036aaa719c86f1de8602e2d2455c16024830035144fcb773c20c1e4b45a54a"} May 28 14:55:35.106806 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.106690 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-th57l" event={"ID":"10338103-c5eb-480b-b58a-86d8b1c9d28a","Type":"ContainerStarted","Data":"a99055c9f1bc800ee622d21ca27dc22e3d1ee4b73db19cf9c5bae52b3d88e6ae"} May 28 14:55:35.126600 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.126557 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-th57l" podStartSLOduration=3.063909989 podStartE2EDuration="4.126542001s" podCreationTimestamp="2026-05-28 14:55:31 +0000 UTC" firstStartedPulling="2026-05-28 14:55:32.303102482 +0000 UTC m=+180.269864230" lastFinishedPulling="2026-05-28 14:55:33.365734497 +0000 UTC m=+181.332496242" observedRunningTime="2026-05-28 14:55:35.125116643 +0000 UTC m=+183.091878408" watchObservedRunningTime="2026-05-28 14:55:35.126542001 +0000 UTC m=+183.093303767" May 28 14:55:35.529877 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.529772 2555 patch_prober.go:28] interesting pod/image-registry-67648996fb-xr64t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 14:55:35.529877 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.529838 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67648996fb-xr64t" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 14:55:35.768565 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.768532 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75b7c86789-9qxbn"] May 28 14:55:35.771067 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.771049 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.774763 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.774732 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 28 14:55:35.774763 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.774743 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9h020vdiicig7\"" May 28 14:55:35.774920 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.774732 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 28 14:55:35.774920 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.774781 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8x7lk\"" May 28 14:55:35.774920 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.774797 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 14:55:35.774920 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.774742 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 28 14:55:35.779862 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.779816 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75b7c86789-9qxbn"] May 28 14:55:35.831999 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.831968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79322a11-2be0-4151-a787-673c9ff014eb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.831999 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.832004 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-client-ca-bundle\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.832213 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.832093 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-secret-metrics-server-client-certs\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.832213 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.832131 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-secret-metrics-server-tls\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.832297 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.832215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lrj\" (UniqueName: \"kubernetes.io/projected/79322a11-2be0-4151-a787-673c9ff014eb-kube-api-access-b2lrj\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.832297 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.832258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79322a11-2be0-4151-a787-673c9ff014eb-audit-log\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.832297 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.832290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79322a11-2be0-4151-a787-673c9ff014eb-metrics-server-audit-profiles\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933255 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933224 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-secret-metrics-server-client-certs\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933417 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933255 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-secret-metrics-server-tls\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933417 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933351 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lrj\" (UniqueName: \"kubernetes.io/projected/79322a11-2be0-4151-a787-673c9ff014eb-kube-api-access-b2lrj\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933415 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79322a11-2be0-4151-a787-673c9ff014eb-audit-log\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933451 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79322a11-2be0-4151-a787-673c9ff014eb-metrics-server-audit-profiles\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933510 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933498 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79322a11-2be0-4151-a787-673c9ff014eb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933661 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933635 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-client-ca-bundle\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.933938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.933908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79322a11-2be0-4151-a787-673c9ff014eb-audit-log\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.934237 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.934215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79322a11-2be0-4151-a787-673c9ff014eb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.934480 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.934454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79322a11-2be0-4151-a787-673c9ff014eb-metrics-server-audit-profiles\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.935911 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.935882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-client-ca-bundle\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.935988 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.935929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-secret-metrics-server-tls\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.935988 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.935976 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79322a11-2be0-4151-a787-673c9ff014eb-secret-metrics-server-client-certs\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:35.941352 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:35.941333 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lrj\" (UniqueName: \"kubernetes.io/projected/79322a11-2be0-4151-a787-673c9ff014eb-kube-api-access-b2lrj\") pod \"metrics-server-75b7c86789-9qxbn\" (UID: \"79322a11-2be0-4151-a787-673c9ff014eb\") " pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:36.081587 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.081559 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:36.175773 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.175742 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5"] May 28 14:55:36.179563 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.179542 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:36.184753 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.184729 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-ptvzm\"" May 28 14:55:36.184892 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.184754 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 28 14:55:36.191509 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.191455 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5"] May 28 14:55:36.230389 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.230359 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75b7c86789-9qxbn"] May 28 14:55:36.233719 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:36.233689 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79322a11_2be0_4151_a787_673c9ff014eb.slice/crio-91cbe94764a8868d0f8ecf5e3ca57799e6793f7b4bf9c156029c3110a5eaa3fe WatchSource:0}: Error finding container 91cbe94764a8868d0f8ecf5e3ca57799e6793f7b4bf9c156029c3110a5eaa3fe: Status 404 returned error can't find the container with id 91cbe94764a8868d0f8ecf5e3ca57799e6793f7b4bf9c156029c3110a5eaa3fe May 28 14:55:36.235452 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.235429 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ec66f5-08ca-49c1-8124-2b1a186171bb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5nbt5\" (UID: \"f1ec66f5-08ca-49c1-8124-2b1a186171bb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:36.336372 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.336273 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ec66f5-08ca-49c1-8124-2b1a186171bb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5nbt5\" (UID: \"f1ec66f5-08ca-49c1-8124-2b1a186171bb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:36.336522 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:36.336420 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 28 14:55:36.336522 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:55:36.336494 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ec66f5-08ca-49c1-8124-2b1a186171bb-monitoring-plugin-cert podName:f1ec66f5-08ca-49c1-8124-2b1a186171bb nodeName:}" failed. No retries permitted until 2026-05-28 14:55:36.836478382 +0000 UTC m=+184.803240125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f1ec66f5-08ca-49c1-8124-2b1a186171bb-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-5nbt5" (UID: "f1ec66f5-08ca-49c1-8124-2b1a186171bb") : secret "monitoring-plugin-cert" not found May 28 14:55:36.841370 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.841325 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ec66f5-08ca-49c1-8124-2b1a186171bb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5nbt5\" (UID: \"f1ec66f5-08ca-49c1-8124-2b1a186171bb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:36.844100 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:36.844073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1ec66f5-08ca-49c1-8124-2b1a186171bb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5nbt5\" (UID: \"f1ec66f5-08ca-49c1-8124-2b1a186171bb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:37.037519 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.037496 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:55:37.090206 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.090184 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:37.117961 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.117935 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"c7d1962cccc234f44b3e13427878e571939b0b2422b782030dc1fd039a77f559"} May 28 14:55:37.118107 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.117974 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"b0c184c00cc5022d2e4a2da5d0f76f2f80fb89c53b20f9b7e3482738d7a89b19"} May 28 14:55:37.119194 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.119146 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" event={"ID":"79322a11-2be0-4151-a787-673c9ff014eb","Type":"ContainerStarted","Data":"91cbe94764a8868d0f8ecf5e3ca57799e6793f7b4bf9c156029c3110a5eaa3fe"} May 28 14:55:37.237835 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.237801 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5"] May 28 14:55:37.240744 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:37.240713 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ec66f5_08ca_49c1_8124_2b1a186171bb.slice/crio-505d3865fbc20b3889cf3394049a48193e596092bd45da544b4232db084e7c71 WatchSource:0}: Error finding container 505d3865fbc20b3889cf3394049a48193e596092bd45da544b4232db084e7c71: Status 404 returned error can't find the container with id 505d3865fbc20b3889cf3394049a48193e596092bd45da544b4232db084e7c71 May 28 14:55:37.546424 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.546348 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:55:37.551086 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.551062 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.553618 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.553597 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 14:55:37.553751 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.553597 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 14:55:37.553932 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.553907 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 14:55:37.554218 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554197 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-904bivkgrkk5g\"" May 28 14:55:37.554329 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554274 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 14:55:37.554389 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554355 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g5tgh\"" May 28 14:55:37.554445 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554419 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 14:55:37.554611 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554593 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 14:55:37.554670 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554640 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 14:55:37.554670 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.554652 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 14:55:37.555043 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.555023 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 14:55:37.555043 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.555034 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 14:55:37.555167 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.555112 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 14:55:37.558454 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.558417 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 14:55:37.564158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.564134 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:55:37.647386 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647386 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647249 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647386 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647386 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647386 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647522 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jtb2\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-kube-api-access-4jtb2\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-config\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647593 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647690 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.647822 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.647810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748585 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748510 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748585 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748563 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748831 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748645 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748831 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748697 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748831 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748733 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748831 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748786 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.748831 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748827 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.749074 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748872 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.749074 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748902 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.749074 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748929 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jtb2\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-kube-api-access-4jtb2\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.749074 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.748972 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-config\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.749594 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.749567 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.749925 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.749982 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750014 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750045 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750074 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750106 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750140 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750152 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750169 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.751755 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.750956 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.752974 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.752947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.753539 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.753518 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-config\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.753653 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.753634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.753743 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.753722 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.754146 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.754105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.754235 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.754177 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.754974 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.754933 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.755378 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.755358 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.755729 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.755707 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.755880 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.755838 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.756058 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.756032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.756176 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.756150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.757246 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.757227 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.758799 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.758775 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jtb2\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-kube-api-access-4jtb2\") pod \"prometheus-k8s-0\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:37.861395 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:37.861360 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:38.124334 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:38.124223 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"c044e94f42e828ae008ad0e3f609a18b6b11ca90c2e4fe62cdfa3efd8217ae66"} May 28 14:55:38.125328 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:38.125285 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" event={"ID":"f1ec66f5-08ca-49c1-8124-2b1a186171bb","Type":"ContainerStarted","Data":"505d3865fbc20b3889cf3394049a48193e596092bd45da544b4232db084e7c71"} May 28 14:55:38.787827 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:38.787758 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:55:38.788582 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:55:38.788553 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a9c77e_cea3_4393_bc10_7488597650f9.slice/crio-b9ef706eb3b108cbe987af46f19e9eb786005c3b2658ec8abdde69b087d6c7d9 WatchSource:0}: Error finding container b9ef706eb3b108cbe987af46f19e9eb786005c3b2658ec8abdde69b087d6c7d9: Status 404 returned error can't find the container with id b9ef706eb3b108cbe987af46f19e9eb786005c3b2658ec8abdde69b087d6c7d9 May 28 14:55:39.133974 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.133889 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"705b39aab9208a7f19fee028e3456a67ce66a69cfc4ebf2852a15e00d7960ea4"} May 28 14:55:39.133974 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.133927 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"82758cf873fe5551876f80137cb0d68ed01706e4f5ce2da597cf096d753b87f7"} May 28 14:55:39.133974 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.133937 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" event={"ID":"3ccc0b65-d4fd-4aac-91f6-7f174affb4fe","Type":"ContainerStarted","Data":"35bc39b43f8ac22aa3532ce1f0d6404541da9c26afe9f8c33f8f9dc077f01b5e"} May 28 14:55:39.134214 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.134072 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:39.135010 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.134979 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"b9ef706eb3b108cbe987af46f19e9eb786005c3b2658ec8abdde69b087d6c7d9"} May 28 14:55:39.136339 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.136299 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" event={"ID":"79322a11-2be0-4151-a787-673c9ff014eb","Type":"ContainerStarted","Data":"27a2262180e48e8c09a25aa508c545ad451b970d1d8e58d46674e4fdc8fb72a5"} May 28 14:55:39.137588 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.137561 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" event={"ID":"f1ec66f5-08ca-49c1-8124-2b1a186171bb","Type":"ContainerStarted","Data":"f22088b819f770de608ea04782be67f7729511dbb71ccab8e6da6a6b578b618d"} May 28 14:55:39.137779 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.137726 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:39.142508 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.142491 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" May 28 14:55:39.155802 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.155755 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" podStartSLOduration=1.317011188 podStartE2EDuration="5.155739852s" podCreationTimestamp="2026-05-28 14:55:34 +0000 UTC" firstStartedPulling="2026-05-28 14:55:34.801945421 +0000 UTC m=+182.768707164" lastFinishedPulling="2026-05-28 14:55:38.640674082 +0000 UTC m=+186.607435828" observedRunningTime="2026-05-28 14:55:39.153940333 +0000 UTC m=+187.120702097" watchObservedRunningTime="2026-05-28 14:55:39.155739852 +0000 UTC m=+187.122501618" May 28 14:55:39.170583 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.170539 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" podStartSLOduration=1.764927971 podStartE2EDuration="4.17052877s" podCreationTimestamp="2026-05-28 14:55:35 +0000 UTC" firstStartedPulling="2026-05-28 14:55:36.236088894 +0000 UTC m=+184.202850638" lastFinishedPulling="2026-05-28 14:55:38.641689676 +0000 UTC m=+186.608451437" observedRunningTime="2026-05-28 14:55:39.16958349 +0000 UTC m=+187.136345256" watchObservedRunningTime="2026-05-28 14:55:39.17052877 +0000 UTC m=+187.137290536" May 28 14:55:39.183476 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:39.183438 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5nbt5" podStartSLOduration=1.781220062 podStartE2EDuration="3.18342796s" podCreationTimestamp="2026-05-28 14:55:36 +0000 UTC" firstStartedPulling="2026-05-28 14:55:37.243074209 +0000 UTC m=+185.209835952" lastFinishedPulling="2026-05-28 14:55:38.645282104 +0000 UTC m=+186.612043850" observedRunningTime="2026-05-28 14:55:39.183070174 +0000 UTC m=+187.149831940" watchObservedRunningTime="2026-05-28 14:55:39.18342796 +0000 UTC m=+187.150189724" May 28 14:55:40.142851 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:40.142767 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" exitCode=0 May 28 14:55:40.143203 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:40.142846 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} May 28 14:55:41.929485 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:41.929454 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67648996fb-xr64t"] May 28 14:55:43.155227 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.155197 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} May 28 14:55:43.155227 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.155231 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} May 28 14:55:43.155711 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.155241 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} May 28 14:55:43.155711 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.155250 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} May 28 14:55:43.155711 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.155258 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} May 28 14:55:43.155711 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.155266 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerStarted","Data":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} May 28 14:55:43.181975 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:43.181927 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.280602183 podStartE2EDuration="6.181913361s" podCreationTimestamp="2026-05-28 14:55:37 +0000 UTC" firstStartedPulling="2026-05-28 14:55:38.790115734 +0000 UTC m=+186.756877484" lastFinishedPulling="2026-05-28 14:55:42.691426919 +0000 UTC m=+190.658188662" observedRunningTime="2026-05-28 14:55:43.180801252 +0000 UTC m=+191.147563052" watchObservedRunningTime="2026-05-28 14:55:43.181913361 +0000 UTC m=+191.148675126" May 28 14:55:45.149278 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:45.149245 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b766ff6cc-xp4vp" May 28 14:55:47.862122 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:47.862087 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:55:56.082288 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:56.082259 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:55:56.082654 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:55:56.082299 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:56:03.213744 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:03.213707 2555 generic.go:358] "Generic (PLEG): container finished" podID="924b2db9-2aa0-4071-a020-93dda946a96a" containerID="e15a7dbec105d16967a4e7e4b51ec7d6201e416055acdd67028bc4e16396523e" exitCode=0 May 28 14:56:03.214114 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:03.213781 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" event={"ID":"924b2db9-2aa0-4071-a020-93dda946a96a","Type":"ContainerDied","Data":"e15a7dbec105d16967a4e7e4b51ec7d6201e416055acdd67028bc4e16396523e"} May 28 14:56:03.214114 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:03.214087 2555 scope.go:117] "RemoveContainer" containerID="e15a7dbec105d16967a4e7e4b51ec7d6201e416055acdd67028bc4e16396523e" May 28 14:56:04.217960 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:04.217920 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-bpxpp" event={"ID":"924b2db9-2aa0-4071-a020-93dda946a96a","Type":"ContainerStarted","Data":"10bd8f0d2fb31bbd83df513c8788ac508b3cb97bb8a452570392a9d20750f270"} May 28 14:56:06.949694 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:06.949631 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67648996fb-xr64t" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerName="registry" containerID="cri-o://9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e" gracePeriod=30 May 28 14:56:07.034063 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.034034 2555 patch_prober.go:28] interesting pod/image-registry-67648996fb-xr64t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= May 28 14:56:07.034180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.034102 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67648996fb-xr64t" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" May 28 14:56:07.193146 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.193123 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:56:07.225968 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.225896 2555 generic.go:358] "Generic (PLEG): container finished" podID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerID="9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e" exitCode=0 May 28 14:56:07.225968 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.225938 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67648996fb-xr64t" event={"ID":"ea536094-e4d0-4dc1-a014-7692c35b9917","Type":"ContainerDied","Data":"9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e"} May 28 14:56:07.226117 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.225978 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67648996fb-xr64t" event={"ID":"ea536094-e4d0-4dc1-a014-7692c35b9917","Type":"ContainerDied","Data":"863592b19185941100f392cbb62548490ac3110cbbdb5bdb83942002d9dfe2ae"} May 28 14:56:07.226117 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.225995 2555 scope.go:117] "RemoveContainer" containerID="9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e" May 28 14:56:07.226117 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.225952 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67648996fb-xr64t" May 28 14:56:07.233988 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.233961 2555 scope.go:117] "RemoveContainer" containerID="9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e" May 28 14:56:07.234239 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:07.234220 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e\": container with ID starting with 9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e not found: ID does not exist" containerID="9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e" May 28 14:56:07.234287 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.234247 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e"} err="failed to get container status \"9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e\": rpc error: code = NotFound desc = could not find container \"9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e\": container with ID starting with 9cc525eddf9c5f695848aa2ccacfa9ba950a96e67972ec9aaa3e17fea5b3fc3e not found: ID does not exist" May 28 14:56:07.313747 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313711 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-trusted-ca\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.313885 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313756 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.313885 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313787 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea536094-e4d0-4dc1-a014-7692c35b9917-ca-trust-extracted\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.313885 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313834 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gbpt\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-kube-api-access-5gbpt\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.313885 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313878 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-image-registry-private-configuration\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.314067 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313901 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-installation-pull-secrets\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.314067 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.313936 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-certificates\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.314067 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.314016 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-bound-sa-token\") pod \"ea536094-e4d0-4dc1-a014-7692c35b9917\" (UID: \"ea536094-e4d0-4dc1-a014-7692c35b9917\") " May 28 14:56:07.314210 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.314127 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:07.314369 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.314347 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-trusted-ca\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.314726 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.314676 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:07.316579 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.316552 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 14:56:07.316683 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.316610 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 14:56:07.316683 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.316608 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:07.316683 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.316631 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-kube-api-access-5gbpt" (OuterVolumeSpecName: "kube-api-access-5gbpt") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "kube-api-access-5gbpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 14:56:07.317006 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.316987 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:07.322280 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.322256 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea536094-e4d0-4dc1-a014-7692c35b9917-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ea536094-e4d0-4dc1-a014-7692c35b9917" (UID: "ea536094-e4d0-4dc1-a014-7692c35b9917"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 14:56:07.415229 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415204 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-bound-sa-token\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.415229 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415226 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-tls\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.415405 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415235 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea536094-e4d0-4dc1-a014-7692c35b9917-ca-trust-extracted\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.415405 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415245 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gbpt\" (UniqueName: \"kubernetes.io/projected/ea536094-e4d0-4dc1-a014-7692c35b9917-kube-api-access-5gbpt\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.415405 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415256 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-image-registry-private-configuration\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.415405 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415267 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea536094-e4d0-4dc1-a014-7692c35b9917-installation-pull-secrets\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.415405 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.415277 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea536094-e4d0-4dc1-a014-7692c35b9917-registry-certificates\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:07.549613 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.549588 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67648996fb-xr64t"] May 28 14:56:07.555123 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:07.555097 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67648996fb-xr64t"] May 28 14:56:08.639380 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:08.639349 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" path="/var/lib/kubelet/pods/ea536094-e4d0-4dc1-a014-7692c35b9917/volumes" May 28 14:56:09.233761 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:09.233732 2555 generic.go:358] "Generic (PLEG): container finished" podID="3474f9e0-ce25-473b-b7e9-51882fcce751" containerID="ade2e857eaebde3b7ecbbfbd396d2fcd1b5176320be8647dcce05a2de88e35ae" exitCode=0 May 28 14:56:09.233923 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:09.233806 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" event={"ID":"3474f9e0-ce25-473b-b7e9-51882fcce751","Type":"ContainerDied","Data":"ade2e857eaebde3b7ecbbfbd396d2fcd1b5176320be8647dcce05a2de88e35ae"} May 28 14:56:09.234139 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:09.234125 2555 scope.go:117] "RemoveContainer" containerID="ade2e857eaebde3b7ecbbfbd396d2fcd1b5176320be8647dcce05a2de88e35ae" May 28 14:56:10.239252 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:10.239203 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-r4m86" event={"ID":"3474f9e0-ce25-473b-b7e9-51882fcce751","Type":"ContainerStarted","Data":"4e18fc2bd3da736188a3cf1006f7fb76d6f85726131c79a336a8bfd29cbcaf5b"} May 28 14:56:16.087211 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:16.087185 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:56:16.091060 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:16.091036 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75b7c86789-9qxbn" May 28 14:56:37.861602 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:37.861569 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:37.877357 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:37.877330 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:38.336417 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:38.336395 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:44.426820 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:44.426781 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:56:44.429068 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:44.429047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966e40a6-12aa-4008-af5e-79ad1884aa83-metrics-certs\") pod \"network-metrics-daemon-qbj7c\" (UID: \"966e40a6-12aa-4008-af5e-79ad1884aa83\") " pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:56:44.539131 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:44.539099 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4kpj5\"" May 28 14:56:44.546762 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:44.546738 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbj7c" May 28 14:56:44.668119 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:44.668094 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qbj7c"] May 28 14:56:44.670597 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:56:44.670570 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966e40a6_12aa_4008_af5e_79ad1884aa83.slice/crio-0071393510a57bcc9ead28b6680aa9f9d22b63b7466ab05df41202885ea5c96d WatchSource:0}: Error finding container 0071393510a57bcc9ead28b6680aa9f9d22b63b7466ab05df41202885ea5c96d: Status 404 returned error can't find the container with id 0071393510a57bcc9ead28b6680aa9f9d22b63b7466ab05df41202885ea5c96d May 28 14:56:45.340892 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:45.340852 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbj7c" event={"ID":"966e40a6-12aa-4008-af5e-79ad1884aa83","Type":"ContainerStarted","Data":"0071393510a57bcc9ead28b6680aa9f9d22b63b7466ab05df41202885ea5c96d"} May 28 14:56:46.344794 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:46.344761 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbj7c" event={"ID":"966e40a6-12aa-4008-af5e-79ad1884aa83","Type":"ContainerStarted","Data":"f53f8ee28d87ce7b33cd32f9387792d68d5e424e8a58fe2fbda534df26b35562"} May 28 14:56:46.345179 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:46.344800 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbj7c" event={"ID":"966e40a6-12aa-4008-af5e-79ad1884aa83","Type":"ContainerStarted","Data":"6e293f45cd33afb9438d272478dcdeff275d01183ac68b75c6609e454b27eab3"} May 28 14:56:46.362629 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:46.362581 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qbj7c" podStartSLOduration=253.411772977 podStartE2EDuration="4m14.362565279s" podCreationTimestamp="2026-05-28 14:52:32 +0000 UTC" firstStartedPulling="2026-05-28 14:56:44.672490963 +0000 UTC m=+252.639252708" lastFinishedPulling="2026-05-28 14:56:45.623283251 +0000 UTC m=+253.590045010" observedRunningTime="2026-05-28 14:56:46.361988466 +0000 UTC m=+254.328750231" watchObservedRunningTime="2026-05-28 14:56:46.362565279 +0000 UTC m=+254.329327043" May 28 14:56:55.925148 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925069 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:56:55.925601 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925508 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="prometheus" containerID="cri-o://d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" gracePeriod=600 May 28 14:56:55.925601 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925541 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy" containerID="cri-o://6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" gracePeriod=600 May 28 14:56:55.925601 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925576 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="thanos-sidecar" containerID="cri-o://bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" gracePeriod=600 May 28 14:56:55.925781 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925574 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" gracePeriod=600 May 28 14:56:55.925781 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925592 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="config-reloader" containerID="cri-o://5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" gracePeriod=600 May 28 14:56:55.925781 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:55.925646 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-web" containerID="cri-o://4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" gracePeriod=600 May 28 14:56:56.171011 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.170987 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.321857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321765 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-metrics-client-certs\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.321857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321805 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-rulefiles-0\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.321857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321832 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-config-out\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.321857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321855 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-kube-rbac-proxy\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321886 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321908 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-trusted-ca-bundle\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321935 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-serving-certs-ca-bundle\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321957 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-grpc-tls\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.321992 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jtb2\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-kube-api-access-4jtb2\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322023 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-config\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322048 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-tls-assets\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322093 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-db\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322124 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-tls\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322173 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322151 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-thanos-prometheus-http-client-file\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322193 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-metrics-client-ca\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322230 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-web-config\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322254 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322285 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-kubelet-serving-ca-bundle\") pod \"a8a9c77e-cea3-4393-bc10-7488597650f9\" (UID: \"a8a9c77e-cea3-4393-bc10-7488597650f9\") " May 28 14:56:56.322689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322374 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:56.322689 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322669 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.322987 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322687 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:56.322987 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.322745 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:56.323176 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.323153 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:56.323503 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.323471 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 14:56:56.323855 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.323731 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 14:56:56.324734 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.324609 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.324837 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.324769 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.324837 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.324777 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-config-out" (OuterVolumeSpecName: "config-out") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 14:56:56.325604 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.325343 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.326387 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.326268 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.326387 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.326353 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 14:56:56.326387 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.326361 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-config" (OuterVolumeSpecName: "config") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.326786 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.326760 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.326963 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.326943 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.327040 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.326978 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-kube-api-access-4jtb2" (OuterVolumeSpecName: "kube-api-access-4jtb2") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "kube-api-access-4jtb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 14:56:56.327356 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.327340 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.336291 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.336271 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-web-config" (OuterVolumeSpecName: "web-config") pod "a8a9c77e-cea3-4393-bc10-7488597650f9" (UID: "a8a9c77e-cea3-4393-bc10-7488597650f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 14:56:56.377059 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377030 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" exitCode=0 May 28 14:56:56.377059 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377057 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" exitCode=0 May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377067 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" exitCode=0 May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377077 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" exitCode=0 May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377084 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" exitCode=0 May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377093 2555 generic.go:358] "Generic (PLEG): container finished" podID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" exitCode=0 May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377102 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377138 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377148 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377158 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377168 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377172 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377177 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377187 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8a9c77e-cea3-4393-bc10-7488597650f9","Type":"ContainerDied","Data":"b9ef706eb3b108cbe987af46f19e9eb786005c3b2658ec8abdde69b087d6c7d9"} May 28 14:56:56.377192 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.377157 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.385583 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.385563 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.392166 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.392146 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.398894 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.398879 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.404085 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.404060 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:56:56.405857 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.405841 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.409049 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.409027 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:56:56.413165 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.413149 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.419614 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.419600 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.423683 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423665 2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-metrics-client-certs\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423685 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423696 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-config-out\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423706 2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-kube-rbac-proxy\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423718 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423728 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423739 2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-grpc-tls\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423747 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jtb2\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-kube-api-access-4jtb2\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423756 2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-config\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.423759 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423764 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8a9c77e-cea3-4393-bc10-7488597650f9-tls-assets\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423772 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8a9c77e-cea3-4393-bc10-7488597650f9-prometheus-k8s-db\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423780 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423789 2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423801 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-metrics-client-ca\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423814 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-web-config\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423826 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8a9c77e-cea3-4393-bc10-7488597650f9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.424180 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.423839 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9c77e-cea3-4393-bc10-7488597650f9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 14:56:56.425698 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.425685 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.425930 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.425910 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.425977 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.425938 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} err="failed to get container status \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" May 28 14:56:56.425977 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.425955 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.426162 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.426146 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.426203 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426169 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} err="failed to get container status \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" May 28 14:56:56.426203 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426190 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.426437 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.426415 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.426475 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426443 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} err="failed to get container status \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" May 28 14:56:56.426475 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426457 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.426668 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.426653 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.426700 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426673 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} err="failed to get container status \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" May 28 14:56:56.426700 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426695 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.426897 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.426884 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.426932 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426901 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} err="failed to get container status \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" May 28 14:56:56.426932 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.426913 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.427129 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.427113 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.427169 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427136 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} err="failed to get container status \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" May 28 14:56:56.427169 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427158 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.427396 ip-10-0-131-234 kubenswrapper[2555]: E0528 14:56:56.427378 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.427468 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427404 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} err="failed to get container status \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" May 28 14:56:56.427468 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427425 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.427678 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427659 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} err="failed to get container status \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" May 28 14:56:56.427725 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427679 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.427895 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427876 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} err="failed to get container status \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" May 28 14:56:56.427964 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.427897 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.428100 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428083 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} err="failed to get container status \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" May 28 14:56:56.428148 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428101 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.428272 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428256 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} err="failed to get container status \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" May 28 14:56:56.428342 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428272 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.428483 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428465 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} err="failed to get container status \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" May 28 14:56:56.428549 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428484 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.428686 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428670 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} err="failed to get container status \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" May 28 14:56:56.428735 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428686 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.428855 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428841 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} err="failed to get container status \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" May 28 14:56:56.428897 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.428855 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.429035 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429020 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} err="failed to get container status \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" May 28 14:56:56.429035 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429035 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.429176 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429162 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} err="failed to get container status \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" May 28 14:56:56.429219 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429175 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.429430 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429410 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} err="failed to get container status \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" May 28 14:56:56.429430 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429430 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.429642 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429627 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} err="failed to get container status \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" May 28 14:56:56.429642 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429641 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.429836 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429819 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} err="failed to get container status \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" May 28 14:56:56.429883 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429836 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.430018 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.429996 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} err="failed to get container status \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" May 28 14:56:56.430065 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430018 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.430176 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430162 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} err="failed to get container status \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" May 28 14:56:56.430219 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430177 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.430379 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430362 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} err="failed to get container status \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" May 28 14:56:56.430379 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430378 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.430556 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430542 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} err="failed to get container status \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" May 28 14:56:56.430556 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430555 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.430767 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430747 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} err="failed to get container status \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" May 28 14:56:56.430842 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430770 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.430999 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430966 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} err="failed to get container status \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" May 28 14:56:56.430999 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.430999 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.431303 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.431277 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} err="failed to get container status \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" May 28 14:56:56.431303 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.431320 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.431793 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.431755 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} err="failed to get container status \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" May 28 14:56:56.431793 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.431783 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.432068 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432044 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} err="failed to get container status \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" May 28 14:56:56.432161 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432070 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.432364 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432346 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} err="failed to get container status \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" May 28 14:56:56.432450 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432374 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.432651 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432631 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} err="failed to get container status \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" May 28 14:56:56.432651 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432650 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.432902 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432869 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} err="failed to get container status \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" May 28 14:56:56.432980 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432903 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.432980 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.432929 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:56:56.433142 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433121 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} err="failed to get container status \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" May 28 14:56:56.433142 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433141 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.433274 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433262 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy" May 28 14:56:56.433337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433277 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy" May 28 14:56:56.433337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433294 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="config-reloader" May 28 14:56:56.433337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433300 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="config-reloader" May 28 14:56:56.433337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433323 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="prometheus" May 28 14:56:56.433337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433331 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="prometheus" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433344 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="init-config-reloader" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433350 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="init-config-reloader" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433357 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerName="registry" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433363 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerName="registry" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433372 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="thanos-sidecar" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433380 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="thanos-sidecar" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433387 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-web" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433392 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-web" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433395 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} err="failed to get container status \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433403 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-thanos" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433410 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433412 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-thanos" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433486 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="prometheus" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433498 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="config-reloader" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433507 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433518 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="thanos-sidecar" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433527 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-thanos" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433539 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" containerName="kube-rbac-proxy-web" May 28 14:56:56.433538 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433549 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea536094-e4d0-4dc1-a014-7692c35b9917" containerName="registry" May 28 14:56:56.434125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433617 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} err="failed to get container status \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" May 28 14:56:56.434125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433638 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.434125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433839 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} err="failed to get container status \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" May 28 14:56:56.434125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.433855 2555 scope.go:117] "RemoveContainer" containerID="f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448" May 28 14:56:56.434125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434060 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448"} err="failed to get container status \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": rpc error: code = NotFound desc = could not find container \"f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448\": container with ID starting with f0396ee4e5185cb861d42186663f7a9dd8ab8f1ab1a382b2de958f498b9ac448 not found: ID does not exist" May 28 14:56:56.434125 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434081 2555 scope.go:117] "RemoveContainer" containerID="6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2" May 28 14:56:56.434381 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434264 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2"} err="failed to get container status \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": rpc error: code = NotFound desc = could not find container \"6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2\": container with ID starting with 6ddb57b4c114eba4fc013150c8cd5d433d5d37dd00a63564ef7ce8c0cfd156f2 not found: ID does not exist" May 28 14:56:56.434381 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434277 2555 scope.go:117] "RemoveContainer" containerID="4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a" May 28 14:56:56.434544 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434517 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a"} err="failed to get container status \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": rpc error: code = NotFound desc = could not find container \"4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a\": container with ID starting with 4d8c153d81f80d51ef9a21d982d6612c3a51e2a7c9508a6c2f01423da7acec2a not found: ID does not exist" May 28 14:56:56.434583 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434545 2555 scope.go:117] "RemoveContainer" containerID="bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57" May 28 14:56:56.434776 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434753 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57"} err="failed to get container status \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": rpc error: code = NotFound desc = could not find container \"bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57\": container with ID starting with bb57ad4b60206e694a1f0ec9d413615fe42a781043a37a9c78ea8db642b43d57 not found: ID does not exist" May 28 14:56:56.434828 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434776 2555 scope.go:117] "RemoveContainer" containerID="5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116" May 28 14:56:56.435000 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.434984 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116"} err="failed to get container status \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": rpc error: code = NotFound desc = could not find container \"5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116\": container with ID starting with 5896de8b760823545cf9f2023aef3c9c7f85dbaa3bd758277855571b61b71116 not found: ID does not exist" May 28 14:56:56.435041 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.435001 2555 scope.go:117] "RemoveContainer" containerID="d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997" May 28 14:56:56.435201 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.435186 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997"} err="failed to get container status \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": rpc error: code = NotFound desc = could not find container \"d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997\": container with ID starting with d540942ee38e04694d0bc746b3e43b53e5336795ec9d3f692fbb42301df72997 not found: ID does not exist" May 28 14:56:56.435246 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.435201 2555 scope.go:117] "RemoveContainer" containerID="b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90" May 28 14:56:56.435410 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.435392 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90"} err="failed to get container status \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": rpc error: code = NotFound desc = could not find container \"b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90\": container with ID starting with b5aa75bba00c70c00c586a0f3cb5b0a938f7e46718ddcfbbf1d92aefda0a4c90 not found: ID does not exist" May 28 14:56:56.438337 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.438302 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.440985 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.440955 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 14:56:56.441084 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.440955 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 14:56:56.441084 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.441040 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 14:56:56.441189 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.441108 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 14:56:56.441340 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.441326 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 14:56:56.441440 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.441420 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 14:56:56.441545 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.441530 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 14:56:56.442149 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.442131 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-904bivkgrkk5g\"" May 28 14:56:56.442233 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.442154 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 14:56:56.442286 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.442236 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 14:56:56.442744 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.442726 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 14:56:56.442917 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.442898 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g5tgh\"" May 28 14:56:56.443997 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.443977 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 14:56:56.446889 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.446867 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 14:56:56.450765 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.450747 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:56:56.524548 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524715 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524715 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524715 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524669 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524715 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524690 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524715 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524740 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524831 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.524938 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.525158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524952 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.525158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.525158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.524995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6khd5\" (UniqueName: \"kubernetes.io/projected/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-kube-api-access-6khd5\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.525158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.525057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-config\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.525158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.525104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.525158 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.525137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626121 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626081 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626144 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626178 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626205 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626245 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626274 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626301 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626344 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626372 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626398 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626426 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626455 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626482 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626509 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626558 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626596 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626627 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khd5\" (UniqueName: \"kubernetes.io/projected/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-kube-api-access-6khd5\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.626691 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.626677 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-config\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.627589 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.627118 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.627589 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.627182 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.627782 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.628930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.629636 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.629773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-config\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.630225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.630263 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.630468 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.631672 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.631178 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.632153 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.631693 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.632269 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.632246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.632612 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.632585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.632891 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.632867 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.633162 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.633144 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.633574 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.633555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.633777 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.633760 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.638754 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.638736 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6khd5\" (UniqueName: \"kubernetes.io/projected/8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d-kube-api-access-6khd5\") pod \"prometheus-k8s-0\" (UID: \"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.639948 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.639927 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a9c77e-cea3-4393-bc10-7488597650f9" path="/var/lib/kubelet/pods/a8a9c77e-cea3-4393-bc10-7488597650f9/volumes" May 28 14:56:56.749270 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.749241 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:56:56.877655 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:56.877628 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 14:56:56.879345 ip-10-0-131-234 kubenswrapper[2555]: W0528 14:56:56.879297 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbc9cf4_302e_46b9_8fa0_ea98e0e4cf5d.slice/crio-f100074996ad39c2c5541ff748d88749ffe5703f7ea75a1659fb3da07719892f WatchSource:0}: Error finding container f100074996ad39c2c5541ff748d88749ffe5703f7ea75a1659fb3da07719892f: Status 404 returned error can't find the container with id f100074996ad39c2c5541ff748d88749ffe5703f7ea75a1659fb3da07719892f May 28 14:56:57.383281 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:57.383243 2555 generic.go:358] "Generic (PLEG): container finished" podID="8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d" containerID="94914522489bed7a1c1dabf0ed2e55ca9e6f1e0e2350c9fd857cbfbdee59326c" exitCode=0 May 28 14:56:57.383281 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:57.383285 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerDied","Data":"94914522489bed7a1c1dabf0ed2e55ca9e6f1e0e2350c9fd857cbfbdee59326c"} May 28 14:56:57.383665 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:57.383305 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"f100074996ad39c2c5541ff748d88749ffe5703f7ea75a1659fb3da07719892f"} May 28 14:56:58.388558 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.388528 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"7bb82c6d98e0996cda16a3230fe3c0095a2ab5a26a1dac307a6c466279b65aef"} May 28 14:56:58.388558 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.388560 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"4da3b0c92ee80b4cf65a6ee6f8f64d26f760fef583490c3cbecf218d2466da2b"} May 28 14:56:58.388967 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.388571 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"9ea3188fb78d88963ac16c4800c6f7a49749adbfec783d38309901810465841b"} May 28 14:56:58.388967 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.388580 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"0753a8d522ec22ce8b9fa27f415566adcd30f703e1f9de424049160610688db6"} May 28 14:56:58.388967 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.388590 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"a2230d4960d0888da8cdd4cfc887f34aee405ea53b7ee867234f6d3277112f6c"} May 28 14:56:58.388967 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.388598 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d","Type":"ContainerStarted","Data":"bc372e40024aee6a4358372e40fa2aa9d64cd227a17fd00511d27885c27c96ae"} May 28 14:56:58.417401 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:56:58.417356 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.417340873 podStartE2EDuration="2.417340873s" podCreationTimestamp="2026-05-28 14:56:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:56:58.41449773 +0000 UTC m=+266.381259496" watchObservedRunningTime="2026-05-28 14:56:58.417340873 +0000 UTC m=+266.384102641" May 28 14:57:01.749993 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:57:01.749960 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:57:32.555427 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:57:32.555407 2555 kubelet.go:1628] "Image garbage collection succeeded" May 28 14:57:56.750138 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:57:56.750105 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:57:56.765413 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:57:56.765384 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 14:57:57.582536 ip-10-0-131-234 kubenswrapper[2555]: I0528 14:57:57.582510 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 15:00:06.022722 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.022685 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-d28st"] May 28 15:00:06.025838 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.025817 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.028304 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.028282 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 28 15:00:06.029352 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.029334 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lj2fm\"" May 28 15:00:06.029448 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.029350 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 28 15:00:06.032768 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.032352 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-d28st"] May 28 15:00:06.069627 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.069599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b444dea-56e9-4378-a6bb-0c98f27813a4-bound-sa-token\") pod \"cert-manager-79c8d999ff-d28st\" (UID: \"8b444dea-56e9-4378-a6bb-0c98f27813a4\") " pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.069749 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.069630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2pw\" (UniqueName: \"kubernetes.io/projected/8b444dea-56e9-4378-a6bb-0c98f27813a4-kube-api-access-mp2pw\") pod \"cert-manager-79c8d999ff-d28st\" (UID: \"8b444dea-56e9-4378-a6bb-0c98f27813a4\") " pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.170852 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.170818 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b444dea-56e9-4378-a6bb-0c98f27813a4-bound-sa-token\") pod \"cert-manager-79c8d999ff-d28st\" (UID: \"8b444dea-56e9-4378-a6bb-0c98f27813a4\") " pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.170852 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.170857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2pw\" (UniqueName: \"kubernetes.io/projected/8b444dea-56e9-4378-a6bb-0c98f27813a4-kube-api-access-mp2pw\") pod \"cert-manager-79c8d999ff-d28st\" (UID: \"8b444dea-56e9-4378-a6bb-0c98f27813a4\") " pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.178815 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.178782 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b444dea-56e9-4378-a6bb-0c98f27813a4-bound-sa-token\") pod \"cert-manager-79c8d999ff-d28st\" (UID: \"8b444dea-56e9-4378-a6bb-0c98f27813a4\") " pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.178920 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.178902 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2pw\" (UniqueName: \"kubernetes.io/projected/8b444dea-56e9-4378-a6bb-0c98f27813a4-kube-api-access-mp2pw\") pod \"cert-manager-79c8d999ff-d28st\" (UID: \"8b444dea-56e9-4378-a6bb-0c98f27813a4\") " pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.347827 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.347800 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-d28st" May 28 15:00:06.466858 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.466835 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-d28st"] May 28 15:00:06.469483 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:00:06.469442 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b444dea_56e9_4378_a6bb_0c98f27813a4.slice/crio-fd2d73d7788d9f7dda0eabeaf5a176c3bde6753914dc5c2b592ca723c4914b6d WatchSource:0}: Error finding container fd2d73d7788d9f7dda0eabeaf5a176c3bde6753914dc5c2b592ca723c4914b6d: Status 404 returned error can't find the container with id fd2d73d7788d9f7dda0eabeaf5a176c3bde6753914dc5c2b592ca723c4914b6d May 28 15:00:06.471274 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.471257 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 15:00:06.930081 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:06.930043 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-d28st" event={"ID":"8b444dea-56e9-4378-a6bb-0c98f27813a4","Type":"ContainerStarted","Data":"fd2d73d7788d9f7dda0eabeaf5a176c3bde6753914dc5c2b592ca723c4914b6d"} May 28 15:00:10.943711 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:10.943676 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-d28st" event={"ID":"8b444dea-56e9-4378-a6bb-0c98f27813a4","Type":"ContainerStarted","Data":"39eef11b59ae3b65c203bd4c5040b24acb43487d130f8ae62c3be73b4e0d23ad"} May 28 15:00:10.961426 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:10.961355 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-d28st" podStartSLOduration=1.188632622 podStartE2EDuration="4.961340055s" podCreationTimestamp="2026-05-28 15:00:06 +0000 UTC" firstStartedPulling="2026-05-28 15:00:06.471463591 +0000 UTC m=+454.438225341" lastFinishedPulling="2026-05-28 15:00:10.244171031 +0000 UTC m=+458.210932774" observedRunningTime="2026-05-28 15:00:10.960453 +0000 UTC m=+458.927214765" watchObservedRunningTime="2026-05-28 15:00:10.961340055 +0000 UTC m=+458.928101820" May 28 15:00:15.073404 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.073370 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj"] May 28 15:00:15.076717 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.076695 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.084780 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.084758 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 15:00:15.084883 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.084786 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 15:00:15.084883 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.084807 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 15:00:15.086032 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.086016 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 15:00:15.086612 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.086591 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 15:00:15.086696 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.086636 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s8sr7\"" May 28 15:00:15.097951 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.097928 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj"] May 28 15:00:15.142607 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.142584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35f13e6f-20e8-4816-8310-edc540945966-cert\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.142704 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.142610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn6zt\" (UniqueName: \"kubernetes.io/projected/35f13e6f-20e8-4816-8310-edc540945966-kube-api-access-mn6zt\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.142704 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.142656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35f13e6f-20e8-4816-8310-edc540945966-manager-config\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.142704 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.142678 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35f13e6f-20e8-4816-8310-edc540945966-metrics-cert\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.243688 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.243657 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35f13e6f-20e8-4816-8310-edc540945966-manager-config\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.243688 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.243687 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35f13e6f-20e8-4816-8310-edc540945966-metrics-cert\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.243844 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.243814 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35f13e6f-20e8-4816-8310-edc540945966-cert\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.243900 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.243850 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mn6zt\" (UniqueName: \"kubernetes.io/projected/35f13e6f-20e8-4816-8310-edc540945966-kube-api-access-mn6zt\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.244414 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.244392 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35f13e6f-20e8-4816-8310-edc540945966-manager-config\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.246226 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.246205 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35f13e6f-20e8-4816-8310-edc540945966-metrics-cert\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.246402 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.246384 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35f13e6f-20e8-4816-8310-edc540945966-cert\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.251739 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.251721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn6zt\" (UniqueName: \"kubernetes.io/projected/35f13e6f-20e8-4816-8310-edc540945966-kube-api-access-mn6zt\") pod \"lws-controller-manager-64f64c6b7b-lggcj\" (UID: \"35f13e6f-20e8-4816-8310-edc540945966\") " pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.386022 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.385943 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:15.512508 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.512389 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj"] May 28 15:00:15.514673 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:00:15.514645 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f13e6f_20e8_4816_8310_edc540945966.slice/crio-d6caa677aa66a432747c20c3ee6bb074ab7ab375a051c10017e0623416b429f1 WatchSource:0}: Error finding container d6caa677aa66a432747c20c3ee6bb074ab7ab375a051c10017e0623416b429f1: Status 404 returned error can't find the container with id d6caa677aa66a432747c20c3ee6bb074ab7ab375a051c10017e0623416b429f1 May 28 15:00:15.961985 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:15.961945 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" event={"ID":"35f13e6f-20e8-4816-8310-edc540945966","Type":"ContainerStarted","Data":"d6caa677aa66a432747c20c3ee6bb074ab7ab375a051c10017e0623416b429f1"} May 28 15:00:17.810654 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.810614 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp"] May 28 15:00:17.821170 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.821140 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.825518 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.825494 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 15:00:17.825674 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.825494 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 15:00:17.826458 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.826371 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 15:00:17.826458 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.826463 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-scgwz\"" May 28 15:00:17.828817 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.828657 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 15:00:17.829952 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.829720 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp"] May 28 15:00:17.868810 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.868780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.868968 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.868880 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhv4\" (UniqueName: \"kubernetes.io/projected/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-kube-api-access-swhv4\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.868968 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.868932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.969780 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.969749 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.969936 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.969810 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swhv4\" (UniqueName: \"kubernetes.io/projected/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-kube-api-access-swhv4\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.969936 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.969840 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.972056 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.972030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.972176 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.972155 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:17.977575 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:17.977552 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhv4\" (UniqueName: \"kubernetes.io/projected/2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace-kube-api-access-swhv4\") pod \"opendatahub-operator-controller-manager-b5d999694-qkswp\" (UID: \"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:18.134483 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:18.134448 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:18.426406 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:18.422704 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp"] May 28 15:00:18.429776 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:00:18.429750 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5ca4da_a2dd_42cf_b0e5_904dd25c2ace.slice/crio-9dfb956635f1fa6f4b40bfc776821e51772a980eb2d4baa5d391ce3350dcea55 WatchSource:0}: Error finding container 9dfb956635f1fa6f4b40bfc776821e51772a980eb2d4baa5d391ce3350dcea55: Status 404 returned error can't find the container with id 9dfb956635f1fa6f4b40bfc776821e51772a980eb2d4baa5d391ce3350dcea55 May 28 15:00:18.976778 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:18.976734 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" event={"ID":"35f13e6f-20e8-4816-8310-edc540945966","Type":"ContainerStarted","Data":"ffd5390140f3df2beeaa8150a96a8a611392069f467f62a9837ad0b6edf9bf06"} May 28 15:00:18.977362 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:18.977324 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:18.978593 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:18.978551 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" event={"ID":"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace","Type":"ContainerStarted","Data":"9dfb956635f1fa6f4b40bfc776821e51772a980eb2d4baa5d391ce3350dcea55"} May 28 15:00:19.000768 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:19.000611 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" podStartSLOduration=1.160677755 podStartE2EDuration="4.000596085s" podCreationTimestamp="2026-05-28 15:00:15 +0000 UTC" firstStartedPulling="2026-05-28 15:00:15.516566785 +0000 UTC m=+463.483328543" lastFinishedPulling="2026-05-28 15:00:18.35648513 +0000 UTC m=+466.323246873" observedRunningTime="2026-05-28 15:00:18.998120116 +0000 UTC m=+466.964881882" watchObservedRunningTime="2026-05-28 15:00:19.000596085 +0000 UTC m=+466.967357866" May 28 15:00:20.986287 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:20.986205 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" event={"ID":"2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace","Type":"ContainerStarted","Data":"5868695e46c7f6e098f1cad3ce2f254c82cb80c9edb998e444bcc3b282768be0"} May 28 15:00:20.986647 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:20.986301 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:00:21.006910 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:21.006860 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" podStartSLOduration=1.715370496 podStartE2EDuration="4.006847377s" podCreationTimestamp="2026-05-28 15:00:17 +0000 UTC" firstStartedPulling="2026-05-28 15:00:18.43145591 +0000 UTC m=+466.398217652" lastFinishedPulling="2026-05-28 15:00:20.72293279 +0000 UTC m=+468.689694533" observedRunningTime="2026-05-28 15:00:21.00506156 +0000 UTC m=+468.971823331" watchObservedRunningTime="2026-05-28 15:00:21.006847377 +0000 UTC m=+468.973609142" May 28 15:00:30.988130 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:30.988098 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64f64c6b7b-lggcj" May 28 15:00:31.992264 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:00:31.992234 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-qkswp" May 28 15:01:15.662685 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.662645 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6"] May 28 15:01:15.665339 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.665302 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.668473 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.668455 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bxvtz\"" May 28 15:01:15.669573 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.669556 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 15:01:15.680640 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.680617 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6"] May 28 15:01:15.758194 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758152 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758368 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5600f800-dce4-4aec-aa89-c883ab72c7bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758368 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758368 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758253 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758368 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758368 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758637 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758637 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.758637 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.758489 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft54g\" (UniqueName: \"kubernetes.io/projected/5600f800-dce4-4aec-aa89-c883ab72c7bb-kube-api-access-ft54g\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859059 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859024 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859201 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859076 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft54g\" (UniqueName: \"kubernetes.io/projected/5600f800-dce4-4aec-aa89-c883ab72c7bb-kube-api-access-ft54g\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859201 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859143 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859201 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859170 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5600f800-dce4-4aec-aa89-c883ab72c7bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859354 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859203 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859354 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859233 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859354 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859265 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859354 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859302 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859557 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859364 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859608 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859575 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859690 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859667 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859746 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859717 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.859831 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.859807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.860022 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.860004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5600f800-dce4-4aec-aa89-c883ab72c7bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.861577 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.861551 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.861674 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.861651 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.867173 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.867146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5600f800-dce4-4aec-aa89-c883ab72c7bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.867384 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.867365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft54g\" (UniqueName: \"kubernetes.io/projected/5600f800-dce4-4aec-aa89-c883ab72c7bb-kube-api-access-ft54g\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6\" (UID: \"5600f800-dce4-4aec-aa89-c883ab72c7bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:15.976821 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:15.976759 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:16.109210 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:16.109184 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6"] May 28 15:01:16.111397 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:01:16.111370 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5600f800_dce4_4aec_aa89_c883ab72c7bb.slice/crio-a26def293e4826404ff629be2c8b96f6d8889f12c0afa11d360bcc3f4ea00b2c WatchSource:0}: Error finding container a26def293e4826404ff629be2c8b96f6d8889f12c0afa11d360bcc3f4ea00b2c: Status 404 returned error can't find the container with id a26def293e4826404ff629be2c8b96f6d8889f12c0afa11d360bcc3f4ea00b2c May 28 15:01:16.176260 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:16.176228 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" event={"ID":"5600f800-dce4-4aec-aa89-c883ab72c7bb","Type":"ContainerStarted","Data":"a26def293e4826404ff629be2c8b96f6d8889f12c0afa11d360bcc3f4ea00b2c"} May 28 15:01:18.463048 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:18.463012 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 15:01:18.463304 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:18.463086 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 15:01:18.463304 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:18.463118 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 15:01:19.187130 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:19.187095 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" event={"ID":"5600f800-dce4-4aec-aa89-c883ab72c7bb","Type":"ContainerStarted","Data":"933b9be25fe3c394edfecb51e713798f4c6f285360afbf9f57e53155d6b477a6"} May 28 15:01:19.207341 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:19.207280 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" podStartSLOduration=1.857902625 podStartE2EDuration="4.207266176s" podCreationTimestamp="2026-05-28 15:01:15 +0000 UTC" firstStartedPulling="2026-05-28 15:01:16.113382611 +0000 UTC m=+524.080144353" lastFinishedPulling="2026-05-28 15:01:18.462746161 +0000 UTC m=+526.429507904" observedRunningTime="2026-05-28 15:01:19.206384394 +0000 UTC m=+527.173146156" watchObservedRunningTime="2026-05-28 15:01:19.207266176 +0000 UTC m=+527.174027940" May 28 15:01:19.977118 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:19.977084 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:19.981819 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:19.981797 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:20.190080 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:20.190055 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:20.191129 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:20.191099 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6" May 28 15:01:36.416902 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.416814 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xrgcr"] May 28 15:01:36.420353 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.420329 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:36.423026 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.422997 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 15:01:36.423026 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.423019 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d6qtj\"" May 28 15:01:36.424512 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.424495 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 15:01:36.426446 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.426423 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xrgcr"] May 28 15:01:36.551038 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.551000 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kvjz\" (UniqueName: \"kubernetes.io/projected/31471b5f-5a20-4077-b051-11bd49376b99-kube-api-access-7kvjz\") pod \"kuadrant-operator-catalog-xrgcr\" (UID: \"31471b5f-5a20-4077-b051-11bd49376b99\") " pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:36.652144 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.652114 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kvjz\" (UniqueName: \"kubernetes.io/projected/31471b5f-5a20-4077-b051-11bd49376b99-kube-api-access-7kvjz\") pod \"kuadrant-operator-catalog-xrgcr\" (UID: \"31471b5f-5a20-4077-b051-11bd49376b99\") " pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:36.661171 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.661137 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kvjz\" (UniqueName: \"kubernetes.io/projected/31471b5f-5a20-4077-b051-11bd49376b99-kube-api-access-7kvjz\") pod \"kuadrant-operator-catalog-xrgcr\" (UID: \"31471b5f-5a20-4077-b051-11bd49376b99\") " pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:36.730856 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.730779 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:36.855195 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.855173 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xrgcr"] May 28 15:01:36.857263 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:01:36.857235 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31471b5f_5a20_4077_b051_11bd49376b99.slice/crio-17ee954462035cf39e69f504c69a8970a62715813f1e1dd52936d92341a6fa3e WatchSource:0}: Error finding container 17ee954462035cf39e69f504c69a8970a62715813f1e1dd52936d92341a6fa3e: Status 404 returned error can't find the container with id 17ee954462035cf39e69f504c69a8970a62715813f1e1dd52936d92341a6fa3e May 28 15:01:36.989114 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:36.989034 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xrgcr"] May 28 15:01:37.005236 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.005207 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8mr"] May 28 15:01:37.009432 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.009413 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:37.014773 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.014747 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8mr"] May 28 15:01:37.156886 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.156849 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkzn\" (UniqueName: \"kubernetes.io/projected/280724fe-36c7-4940-8703-b2b913b94f10-kube-api-access-cvkzn\") pod \"kuadrant-operator-catalog-kz8mr\" (UID: \"280724fe-36c7-4940-8703-b2b913b94f10\") " pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:37.244785 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.244706 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" event={"ID":"31471b5f-5a20-4077-b051-11bd49376b99","Type":"ContainerStarted","Data":"17ee954462035cf39e69f504c69a8970a62715813f1e1dd52936d92341a6fa3e"} May 28 15:01:37.258246 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.258213 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkzn\" (UniqueName: \"kubernetes.io/projected/280724fe-36c7-4940-8703-b2b913b94f10-kube-api-access-cvkzn\") pod \"kuadrant-operator-catalog-kz8mr\" (UID: \"280724fe-36c7-4940-8703-b2b913b94f10\") " pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:37.266656 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.266616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkzn\" (UniqueName: \"kubernetes.io/projected/280724fe-36c7-4940-8703-b2b913b94f10-kube-api-access-cvkzn\") pod \"kuadrant-operator-catalog-kz8mr\" (UID: \"280724fe-36c7-4940-8703-b2b913b94f10\") " pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:37.320270 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.320241 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:37.459987 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:37.459950 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8mr"] May 28 15:01:37.542004 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:01:37.541931 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280724fe_36c7_4940_8703_b2b913b94f10.slice/crio-27fe8d885a296ebd12b5826057f643edf1cb456a529c5a08ae4a54d5b0616a47 WatchSource:0}: Error finding container 27fe8d885a296ebd12b5826057f643edf1cb456a529c5a08ae4a54d5b0616a47: Status 404 returned error can't find the container with id 27fe8d885a296ebd12b5826057f643edf1cb456a529c5a08ae4a54d5b0616a47 May 28 15:01:38.249580 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:38.249551 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" event={"ID":"280724fe-36c7-4940-8703-b2b913b94f10","Type":"ContainerStarted","Data":"27fe8d885a296ebd12b5826057f643edf1cb456a529c5a08ae4a54d5b0616a47"} May 28 15:01:39.254208 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.254103 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" event={"ID":"280724fe-36c7-4940-8703-b2b913b94f10","Type":"ContainerStarted","Data":"2b0c3ca158622b4f9ef0ca99397814dcd2661e7374742eb2d002333eae79ef36"} May 28 15:01:39.255496 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.255477 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" event={"ID":"31471b5f-5a20-4077-b051-11bd49376b99","Type":"ContainerStarted","Data":"69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565"} May 28 15:01:39.255566 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.255546 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" podUID="31471b5f-5a20-4077-b051-11bd49376b99" containerName="registry-server" containerID="cri-o://69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565" gracePeriod=2 May 28 15:01:39.269894 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.269784 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" podStartSLOduration=1.9064813090000001 podStartE2EDuration="3.269769845s" podCreationTimestamp="2026-05-28 15:01:36 +0000 UTC" firstStartedPulling="2026-05-28 15:01:37.543239163 +0000 UTC m=+545.510000906" lastFinishedPulling="2026-05-28 15:01:38.906527697 +0000 UTC m=+546.873289442" observedRunningTime="2026-05-28 15:01:39.267769898 +0000 UTC m=+547.234531664" watchObservedRunningTime="2026-05-28 15:01:39.269769845 +0000 UTC m=+547.236531612" May 28 15:01:39.281359 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.281305 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" podStartSLOduration=1.236574844 podStartE2EDuration="3.281290519s" podCreationTimestamp="2026-05-28 15:01:36 +0000 UTC" firstStartedPulling="2026-05-28 15:01:36.8586559 +0000 UTC m=+544.825417646" lastFinishedPulling="2026-05-28 15:01:38.903371565 +0000 UTC m=+546.870133321" observedRunningTime="2026-05-28 15:01:39.280188428 +0000 UTC m=+547.246950186" watchObservedRunningTime="2026-05-28 15:01:39.281290519 +0000 UTC m=+547.248052284" May 28 15:01:39.495805 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.495784 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:39.684585 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.684546 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kvjz\" (UniqueName: \"kubernetes.io/projected/31471b5f-5a20-4077-b051-11bd49376b99-kube-api-access-7kvjz\") pod \"31471b5f-5a20-4077-b051-11bd49376b99\" (UID: \"31471b5f-5a20-4077-b051-11bd49376b99\") " May 28 15:01:39.686692 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.686666 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31471b5f-5a20-4077-b051-11bd49376b99-kube-api-access-7kvjz" (OuterVolumeSpecName: "kube-api-access-7kvjz") pod "31471b5f-5a20-4077-b051-11bd49376b99" (UID: "31471b5f-5a20-4077-b051-11bd49376b99"). InnerVolumeSpecName "kube-api-access-7kvjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:01:39.785733 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:39.785691 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kvjz\" (UniqueName: \"kubernetes.io/projected/31471b5f-5a20-4077-b051-11bd49376b99-kube-api-access-7kvjz\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:01:40.259789 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.259751 2555 generic.go:358] "Generic (PLEG): container finished" podID="31471b5f-5a20-4077-b051-11bd49376b99" containerID="69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565" exitCode=0 May 28 15:01:40.260200 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.259813 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" May 28 15:01:40.260200 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.259839 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" event={"ID":"31471b5f-5a20-4077-b051-11bd49376b99","Type":"ContainerDied","Data":"69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565"} May 28 15:01:40.260200 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.259877 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xrgcr" event={"ID":"31471b5f-5a20-4077-b051-11bd49376b99","Type":"ContainerDied","Data":"17ee954462035cf39e69f504c69a8970a62715813f1e1dd52936d92341a6fa3e"} May 28 15:01:40.260200 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.259898 2555 scope.go:117] "RemoveContainer" containerID="69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565" May 28 15:01:40.268576 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.268561 2555 scope.go:117] "RemoveContainer" containerID="69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565" May 28 15:01:40.268829 ip-10-0-131-234 kubenswrapper[2555]: E0528 15:01:40.268811 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565\": container with ID starting with 69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565 not found: ID does not exist" containerID="69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565" May 28 15:01:40.268892 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.268840 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565"} err="failed to get container status \"69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565\": rpc error: code = NotFound desc = could not find container \"69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565\": container with ID starting with 69f306a8a86b069d2d2181e86ffb8cf4dff714215a92cffa1d8db8a05ba3c565 not found: ID does not exist" May 28 15:01:40.280815 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.280789 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xrgcr"] May 28 15:01:40.283283 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.283262 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xrgcr"] May 28 15:01:40.639795 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:40.639761 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31471b5f-5a20-4077-b051-11bd49376b99" path="/var/lib/kubelet/pods/31471b5f-5a20-4077-b051-11bd49376b99/volumes" May 28 15:01:47.320683 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:47.320645 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:47.320683 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:47.320695 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:47.342971 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:47.342931 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:01:48.306424 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:01:48.306391 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kz8mr" May 28 15:02:07.810081 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.810047 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw"] May 28 15:02:07.810553 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.810385 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31471b5f-5a20-4077-b051-11bd49376b99" containerName="registry-server" May 28 15:02:07.810553 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.810399 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="31471b5f-5a20-4077-b051-11bd49376b99" containerName="registry-server" May 28 15:02:07.810553 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.810485 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="31471b5f-5a20-4077-b051-11bd49376b99" containerName="registry-server" May 28 15:02:07.816525 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.816507 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:07.819179 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.819160 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-th2t5\"" May 28 15:02:07.824027 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.824004 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw"] May 28 15:02:07.916828 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:07.916796 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gs5q\" (UniqueName: \"kubernetes.io/projected/f5956cb9-fb70-42cf-b8ad-c047146dbb8a-kube-api-access-8gs5q\") pod \"limitador-operator-controller-manager-85c4996f8c-nlfvw\" (UID: \"f5956cb9-fb70-42cf-b8ad-c047146dbb8a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:08.017880 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:08.017843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gs5q\" (UniqueName: \"kubernetes.io/projected/f5956cb9-fb70-42cf-b8ad-c047146dbb8a-kube-api-access-8gs5q\") pod \"limitador-operator-controller-manager-85c4996f8c-nlfvw\" (UID: \"f5956cb9-fb70-42cf-b8ad-c047146dbb8a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:08.028289 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:08.028249 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gs5q\" (UniqueName: \"kubernetes.io/projected/f5956cb9-fb70-42cf-b8ad-c047146dbb8a-kube-api-access-8gs5q\") pod \"limitador-operator-controller-manager-85c4996f8c-nlfvw\" (UID: \"f5956cb9-fb70-42cf-b8ad-c047146dbb8a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:08.127010 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:08.126969 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:08.255174 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:08.255148 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw"] May 28 15:02:08.256540 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:02:08.256511 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5956cb9_fb70_42cf_b8ad_c047146dbb8a.slice/crio-9f4228b4d366cecc4152951a54615c7a12d5362e1b4ea91c9a2828aa09bb7d41 WatchSource:0}: Error finding container 9f4228b4d366cecc4152951a54615c7a12d5362e1b4ea91c9a2828aa09bb7d41: Status 404 returned error can't find the container with id 9f4228b4d366cecc4152951a54615c7a12d5362e1b4ea91c9a2828aa09bb7d41 May 28 15:02:08.350829 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:08.350792 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" event={"ID":"f5956cb9-fb70-42cf-b8ad-c047146dbb8a","Type":"ContainerStarted","Data":"9f4228b4d366cecc4152951a54615c7a12d5362e1b4ea91c9a2828aa09bb7d41"} May 28 15:02:11.363082 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:11.363041 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" event={"ID":"f5956cb9-fb70-42cf-b8ad-c047146dbb8a","Type":"ContainerStarted","Data":"132fff89ca4ae1b699997a383bf2cacbc539486bdaddb4e11d9f811b457802e5"} May 28 15:02:11.363480 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:11.363154 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:11.383500 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:11.383457 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" podStartSLOduration=2.103165601 podStartE2EDuration="4.383445605s" podCreationTimestamp="2026-05-28 15:02:07 +0000 UTC" firstStartedPulling="2026-05-28 15:02:08.258405817 +0000 UTC m=+576.225167559" lastFinishedPulling="2026-05-28 15:02:10.538685819 +0000 UTC m=+578.505447563" observedRunningTime="2026-05-28 15:02:11.381792265 +0000 UTC m=+579.348554030" watchObservedRunningTime="2026-05-28 15:02:11.383445605 +0000 UTC m=+579.350207370" May 28 15:02:15.600645 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.600612 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dn9d8"] May 28 15:02:15.605403 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.605387 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:15.608295 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.608277 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-twmr7\"" May 28 15:02:15.618728 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.618707 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dn9d8"] May 28 15:02:15.690238 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.690204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kbsh\" (UniqueName: \"kubernetes.io/projected/9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451-kube-api-access-5kbsh\") pod \"authorino-operator-657f44b778-dn9d8\" (UID: \"9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451\") " pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:15.791519 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.791484 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kbsh\" (UniqueName: \"kubernetes.io/projected/9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451-kube-api-access-5kbsh\") pod \"authorino-operator-657f44b778-dn9d8\" (UID: \"9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451\") " pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:15.800415 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.800384 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kbsh\" (UniqueName: \"kubernetes.io/projected/9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451-kube-api-access-5kbsh\") pod \"authorino-operator-657f44b778-dn9d8\" (UID: \"9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451\") " pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:15.914937 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:15.914854 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:16.041839 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:16.041750 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dn9d8"] May 28 15:02:16.044910 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:02:16.044873 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3a6b9b_d47f_4bcf_abc8_2389f3fcf451.slice/crio-f3c6f060b940b8ae527c27fa5829de813c263dd55721c2b49da54d07853ff55f WatchSource:0}: Error finding container f3c6f060b940b8ae527c27fa5829de813c263dd55721c2b49da54d07853ff55f: Status 404 returned error can't find the container with id f3c6f060b940b8ae527c27fa5829de813c263dd55721c2b49da54d07853ff55f May 28 15:02:16.381632 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:16.381598 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" event={"ID":"9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451","Type":"ContainerStarted","Data":"f3c6f060b940b8ae527c27fa5829de813c263dd55721c2b49da54d07853ff55f"} May 28 15:02:18.391002 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:18.390955 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" event={"ID":"9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451","Type":"ContainerStarted","Data":"ed37c715753ce659d4842674e6cd04bc5f4dadfaa79834c7ccf8ccdc0567f027"} May 28 15:02:18.391371 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:18.391059 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:22.369789 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:22.369756 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:22.393381 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:22.393327 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" podStartSLOduration=5.179954012 podStartE2EDuration="7.393301099s" podCreationTimestamp="2026-05-28 15:02:15 +0000 UTC" firstStartedPulling="2026-05-28 15:02:16.046738242 +0000 UTC m=+584.013499990" lastFinishedPulling="2026-05-28 15:02:18.260085334 +0000 UTC m=+586.226847077" observedRunningTime="2026-05-28 15:02:18.406832959 +0000 UTC m=+586.373594725" watchObservedRunningTime="2026-05-28 15:02:22.393301099 +0000 UTC m=+590.360062863" May 28 15:02:29.396922 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:29.396890 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-dn9d8" May 28 15:02:32.314353 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.314293 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw"] May 28 15:02:32.314719 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.314566 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" containerName="manager" containerID="cri-o://132fff89ca4ae1b699997a383bf2cacbc539486bdaddb4e11d9f811b457802e5" gracePeriod=2 May 28 15:02:32.323130 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.323101 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw"] May 28 15:02:32.359182 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.359149 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w"] May 28 15:02:32.359524 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.359507 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" containerName="manager" May 28 15:02:32.359524 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.359523 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" containerName="manager" May 28 15:02:32.359687 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.359597 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" containerName="manager" May 28 15:02:32.362400 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.362381 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:02:32.373474 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.373441 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" err="pods \"limitador-operator-controller-manager-85c4996f8c-nlfvw\" is forbidden: User \"system:node:ip-10-0-131-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-234.ec2.internal' and this object" May 28 15:02:32.396036 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.396008 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w"] May 28 15:02:32.440201 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.440164 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7j6j\" (UniqueName: \"kubernetes.io/projected/b64124b8-0f84-4488-8cc7-efb72de64a33-kube-api-access-w7j6j\") pod \"limitador-operator-controller-manager-85c4996f8c-kpr7w\" (UID: \"b64124b8-0f84-4488-8cc7-efb72de64a33\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:02:32.442149 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.442117 2555 generic.go:358] "Generic (PLEG): container finished" podID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" containerID="132fff89ca4ae1b699997a383bf2cacbc539486bdaddb4e11d9f811b457802e5" exitCode=0 May 28 15:02:32.540883 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.540858 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7j6j\" (UniqueName: \"kubernetes.io/projected/b64124b8-0f84-4488-8cc7-efb72de64a33-kube-api-access-w7j6j\") pod \"limitador-operator-controller-manager-85c4996f8c-kpr7w\" (UID: \"b64124b8-0f84-4488-8cc7-efb72de64a33\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:02:32.547719 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.547693 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:32.549954 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.549916 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" err="pods \"limitador-operator-controller-manager-85c4996f8c-nlfvw\" is forbidden: User \"system:node:ip-10-0-131-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-234.ec2.internal' and this object" May 28 15:02:32.551981 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.551955 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7j6j\" (UniqueName: \"kubernetes.io/projected/b64124b8-0f84-4488-8cc7-efb72de64a33-kube-api-access-w7j6j\") pod \"limitador-operator-controller-manager-85c4996f8c-kpr7w\" (UID: \"b64124b8-0f84-4488-8cc7-efb72de64a33\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:02:32.645688 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.645650 2555 status_manager.go:895] "Failed to get status for pod" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" err="pods \"limitador-operator-controller-manager-85c4996f8c-nlfvw\" is forbidden: User \"system:node:ip-10-0-131-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-234.ec2.internal' and this object" May 28 15:02:32.701753 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.701728 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:02:32.743153 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.743125 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gs5q\" (UniqueName: \"kubernetes.io/projected/f5956cb9-fb70-42cf-b8ad-c047146dbb8a-kube-api-access-8gs5q\") pod \"f5956cb9-fb70-42cf-b8ad-c047146dbb8a\" (UID: \"f5956cb9-fb70-42cf-b8ad-c047146dbb8a\") " May 28 15:02:32.745126 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.745098 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5956cb9-fb70-42cf-b8ad-c047146dbb8a-kube-api-access-8gs5q" (OuterVolumeSpecName: "kube-api-access-8gs5q") pod "f5956cb9-fb70-42cf-b8ad-c047146dbb8a" (UID: "f5956cb9-fb70-42cf-b8ad-c047146dbb8a"). InnerVolumeSpecName "kube-api-access-8gs5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:02:32.829883 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.829848 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w"] May 28 15:02:32.843647 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:32.843626 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gs5q\" (UniqueName: \"kubernetes.io/projected/f5956cb9-fb70-42cf-b8ad-c047146dbb8a-kube-api-access-8gs5q\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:02:33.368166 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.368122 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.30:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" May 28 15:02:33.447211 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.447184 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nlfvw" May 28 15:02:33.447211 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.447209 2555 scope.go:117] "RemoveContainer" containerID="132fff89ca4ae1b699997a383bf2cacbc539486bdaddb4e11d9f811b457802e5" May 28 15:02:33.448723 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.448696 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" event={"ID":"b64124b8-0f84-4488-8cc7-efb72de64a33","Type":"ContainerStarted","Data":"ccf65bd2120d32f583bdcaf073e1f5a1164cf77658d16e717eb9e7d76d4f43ad"} May 28 15:02:33.448835 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.448733 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" event={"ID":"b64124b8-0f84-4488-8cc7-efb72de64a33","Type":"ContainerStarted","Data":"68d649649a1763113a795b33f29ff28e6a06fda6c132d59785acd7f49dd1f027"} May 28 15:02:33.448835 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.448833 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:02:33.497386 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:33.497338 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" podStartSLOduration=1.497325273 podStartE2EDuration="1.497325273s" podCreationTimestamp="2026-05-28 15:02:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:02:33.49457876 +0000 UTC m=+601.461340537" watchObservedRunningTime="2026-05-28 15:02:33.497325273 +0000 UTC m=+601.464087029" May 28 15:02:34.639585 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:34.639550 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5956cb9-fb70-42cf-b8ad-c047146dbb8a" path="/var/lib/kubelet/pods/f5956cb9-fb70-42cf-b8ad-c047146dbb8a/volumes" May 28 15:02:44.455767 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:02:44.455730 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kpr7w" May 28 15:03:00.808901 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.808859 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr"] May 28 15:03:00.811378 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.811357 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.813976 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.813954 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5pr5v\"" May 28 15:03:00.824281 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.824252 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr"] May 28 15:03:00.869834 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.869802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gt2\" (UniqueName: \"kubernetes.io/projected/53eafebb-138d-4a3c-bbb6-d03e8017d9be-kube-api-access-q6gt2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870030 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.869841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870030 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.869869 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870030 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.869966 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870030 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.870003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870213 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.870100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870213 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.870142 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870213 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.870162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.870213 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.870205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971517 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971479 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971710 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971710 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971668 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971830 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971718 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971830 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971758 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gt2\" (UniqueName: \"kubernetes.io/projected/53eafebb-138d-4a3c-bbb6-d03e8017d9be-kube-api-access-q6gt2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971830 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971796 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971984 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971842 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971984 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971882 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971984 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.971984 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971912 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.972192 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.971981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.972192 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.972063 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.972278 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.972206 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.972559 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.972534 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.973862 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.973845 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.974186 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.974171 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.980882 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.980858 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gt2\" (UniqueName: \"kubernetes.io/projected/53eafebb-138d-4a3c-bbb6-d03e8017d9be-kube-api-access-q6gt2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:00.980999 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:00.980931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53eafebb-138d-4a3c-bbb6-d03e8017d9be-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qn5wr\" (UID: \"53eafebb-138d-4a3c-bbb6-d03e8017d9be\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:01.124506 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.124470 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:01.262474 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.262393 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr"] May 28 15:03:01.265357 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:03:01.265330 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53eafebb_138d_4a3c_bbb6_d03e8017d9be.slice/crio-4bfca762f3257112a5ad8f5646945e744e176d9f2cb779451975178df4b2dd2c WatchSource:0}: Error finding container 4bfca762f3257112a5ad8f5646945e744e176d9f2cb779451975178df4b2dd2c: Status 404 returned error can't find the container with id 4bfca762f3257112a5ad8f5646945e744e176d9f2cb779451975178df4b2dd2c May 28 15:03:01.267573 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.267543 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 15:03:01.267653 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.267604 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 15:03:01.267653 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.267629 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 28 15:03:01.543569 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.543488 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" event={"ID":"53eafebb-138d-4a3c-bbb6-d03e8017d9be","Type":"ContainerStarted","Data":"130e3fd1033ffc28cce97bfddba6206638e5f35f0d7e68d23146135135436071"} May 28 15:03:01.543569 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.543524 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" event={"ID":"53eafebb-138d-4a3c-bbb6-d03e8017d9be","Type":"ContainerStarted","Data":"4bfca762f3257112a5ad8f5646945e744e176d9f2cb779451975178df4b2dd2c"} May 28 15:03:01.565760 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:01.565711 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" podStartSLOduration=1.5656971240000002 podStartE2EDuration="1.565697124s" podCreationTimestamp="2026-05-28 15:03:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:03:01.565050814 +0000 UTC m=+629.531812580" watchObservedRunningTime="2026-05-28 15:03:01.565697124 +0000 UTC m=+629.532458888" May 28 15:03:02.125513 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:02.125478 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:02.130059 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:02.130034 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:02.547742 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:02.547666 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:02.548797 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:02.548779 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qn5wr" May 28 15:03:16.124469 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.124433 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jwsn4"] May 28 15:03:16.126990 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.126974 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:16.129482 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.129460 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k54db\"" May 28 15:03:16.134863 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.134828 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jwsn4"] May 28 15:03:16.207344 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.207291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8dfn\" (UniqueName: \"kubernetes.io/projected/36efe9d3-c2bc-497e-9fe5-c8156362f4f1-kube-api-access-g8dfn\") pod \"authorino-f99f4b5cd-jwsn4\" (UID: \"36efe9d3-c2bc-497e-9fe5-c8156362f4f1\") " pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:16.308824 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.308796 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8dfn\" (UniqueName: \"kubernetes.io/projected/36efe9d3-c2bc-497e-9fe5-c8156362f4f1-kube-api-access-g8dfn\") pod \"authorino-f99f4b5cd-jwsn4\" (UID: \"36efe9d3-c2bc-497e-9fe5-c8156362f4f1\") " pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:16.316995 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.316970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8dfn\" (UniqueName: \"kubernetes.io/projected/36efe9d3-c2bc-497e-9fe5-c8156362f4f1-kube-api-access-g8dfn\") pod \"authorino-f99f4b5cd-jwsn4\" (UID: \"36efe9d3-c2bc-497e-9fe5-c8156362f4f1\") " pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:16.438171 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.438079 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:16.566112 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.566089 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jwsn4"] May 28 15:03:16.568238 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:03:16.568212 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36efe9d3_c2bc_497e_9fe5_c8156362f4f1.slice/crio-4a8ddca6c1ff60bae2585a8f9718e95bc059ab5084c657ae9b4dd7244d553be3 WatchSource:0}: Error finding container 4a8ddca6c1ff60bae2585a8f9718e95bc059ab5084c657ae9b4dd7244d553be3: Status 404 returned error can't find the container with id 4a8ddca6c1ff60bae2585a8f9718e95bc059ab5084c657ae9b4dd7244d553be3 May 28 15:03:16.600641 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:16.600606 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" event={"ID":"36efe9d3-c2bc-497e-9fe5-c8156362f4f1","Type":"ContainerStarted","Data":"4a8ddca6c1ff60bae2585a8f9718e95bc059ab5084c657ae9b4dd7244d553be3"} May 28 15:03:20.619147 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:20.619114 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" event={"ID":"36efe9d3-c2bc-497e-9fe5-c8156362f4f1","Type":"ContainerStarted","Data":"82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0"} May 28 15:03:20.634076 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:20.634025 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" podStartSLOduration=1.3153806719999999 podStartE2EDuration="4.634010487s" podCreationTimestamp="2026-05-28 15:03:16 +0000 UTC" firstStartedPulling="2026-05-28 15:03:16.569599735 +0000 UTC m=+644.536361478" lastFinishedPulling="2026-05-28 15:03:19.888229546 +0000 UTC m=+647.854991293" observedRunningTime="2026-05-28 15:03:20.632179749 +0000 UTC m=+648.598941514" watchObservedRunningTime="2026-05-28 15:03:20.634010487 +0000 UTC m=+648.600772251" May 28 15:03:20.927665 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:20.927584 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jwsn4"] May 28 15:03:22.626276 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:22.626227 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" podUID="36efe9d3-c2bc-497e-9fe5-c8156362f4f1" containerName="authorino" containerID="cri-o://82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0" gracePeriod=30 May 28 15:03:22.868943 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:22.868922 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:22.971375 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:22.971289 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8dfn\" (UniqueName: \"kubernetes.io/projected/36efe9d3-c2bc-497e-9fe5-c8156362f4f1-kube-api-access-g8dfn\") pod \"36efe9d3-c2bc-497e-9fe5-c8156362f4f1\" (UID: \"36efe9d3-c2bc-497e-9fe5-c8156362f4f1\") " May 28 15:03:22.973442 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:22.973416 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36efe9d3-c2bc-497e-9fe5-c8156362f4f1-kube-api-access-g8dfn" (OuterVolumeSpecName: "kube-api-access-g8dfn") pod "36efe9d3-c2bc-497e-9fe5-c8156362f4f1" (UID: "36efe9d3-c2bc-497e-9fe5-c8156362f4f1"). InnerVolumeSpecName "kube-api-access-g8dfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:03:23.072390 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.072342 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8dfn\" (UniqueName: \"kubernetes.io/projected/36efe9d3-c2bc-497e-9fe5-c8156362f4f1-kube-api-access-g8dfn\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:03:23.630374 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.630341 2555 generic.go:358] "Generic (PLEG): container finished" podID="36efe9d3-c2bc-497e-9fe5-c8156362f4f1" containerID="82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0" exitCode=0 May 28 15:03:23.630761 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.630447 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" May 28 15:03:23.630761 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.630453 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" event={"ID":"36efe9d3-c2bc-497e-9fe5-c8156362f4f1","Type":"ContainerDied","Data":"82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0"} May 28 15:03:23.630761 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.630485 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jwsn4" event={"ID":"36efe9d3-c2bc-497e-9fe5-c8156362f4f1","Type":"ContainerDied","Data":"4a8ddca6c1ff60bae2585a8f9718e95bc059ab5084c657ae9b4dd7244d553be3"} May 28 15:03:23.630761 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.630505 2555 scope.go:117] "RemoveContainer" containerID="82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0" May 28 15:03:23.638852 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.638835 2555 scope.go:117] "RemoveContainer" containerID="82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0" May 28 15:03:23.639105 ip-10-0-131-234 kubenswrapper[2555]: E0528 15:03:23.639086 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0\": container with ID starting with 82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0 not found: ID does not exist" containerID="82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0" May 28 15:03:23.639162 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.639114 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0"} err="failed to get container status \"82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0\": rpc error: code = NotFound desc = could not find container \"82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0\": container with ID starting with 82539a48a405cff5c198b70460f2bc5b548345bb3015a903c6a9e87074db2aa0 not found: ID does not exist" May 28 15:03:23.650168 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.650144 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jwsn4"] May 28 15:03:23.653717 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:23.653697 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jwsn4"] May 28 15:03:24.638581 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:24.638550 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36efe9d3-c2bc-497e-9fe5-c8156362f4f1" path="/var/lib/kubelet/pods/36efe9d3-c2bc-497e-9fe5-c8156362f4f1/volumes" May 28 15:03:49.369619 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.369589 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5vfzb"] May 28 15:03:49.370019 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.369934 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36efe9d3-c2bc-497e-9fe5-c8156362f4f1" containerName="authorino" May 28 15:03:49.370019 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.369945 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="36efe9d3-c2bc-497e-9fe5-c8156362f4f1" containerName="authorino" May 28 15:03:49.370019 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.370017 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="36efe9d3-c2bc-497e-9fe5-c8156362f4f1" containerName="authorino" May 28 15:03:49.374354 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.374335 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:49.377062 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.377037 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k54db\"" May 28 15:03:49.378765 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.378744 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5vfzb"] May 28 15:03:49.402233 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.402212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8drkk\" (UniqueName: \"kubernetes.io/projected/c692b159-83b9-42dc-a514-418c4e80296d-kube-api-access-8drkk\") pod \"authorino-8b475cf9f-5vfzb\" (UID: \"c692b159-83b9-42dc-a514-418c4e80296d\") " pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:49.503672 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.503645 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8drkk\" (UniqueName: \"kubernetes.io/projected/c692b159-83b9-42dc-a514-418c4e80296d-kube-api-access-8drkk\") pod \"authorino-8b475cf9f-5vfzb\" (UID: \"c692b159-83b9-42dc-a514-418c4e80296d\") " pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:49.512207 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.512179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8drkk\" (UniqueName: \"kubernetes.io/projected/c692b159-83b9-42dc-a514-418c4e80296d-kube-api-access-8drkk\") pod \"authorino-8b475cf9f-5vfzb\" (UID: \"c692b159-83b9-42dc-a514-418c4e80296d\") " pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:49.601339 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.601299 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5vfzb"] May 28 15:03:49.601588 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.601577 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:49.629070 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.629017 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-768bffc59f-j5fpv"] May 28 15:03:49.633516 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.633496 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:49.640110 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.640068 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768bffc59f-j5fpv"] May 28 15:03:49.705904 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.705874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrsz\" (UniqueName: \"kubernetes.io/projected/9fa5a267-4966-4ab6-9184-4594c63a6663-kube-api-access-rnrsz\") pod \"authorino-768bffc59f-j5fpv\" (UID: \"9fa5a267-4966-4ab6-9184-4594c63a6663\") " pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:49.722271 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.722244 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768bffc59f-j5fpv"] May 28 15:03:49.722589 ip-10-0-131-234 kubenswrapper[2555]: E0528 15:03:49.722566 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rnrsz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-768bffc59f-j5fpv" podUID="9fa5a267-4966-4ab6-9184-4594c63a6663" May 28 15:03:49.736225 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.736204 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5vfzb"] May 28 15:03:49.738040 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:03:49.738018 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc692b159_83b9_42dc_a514_418c4e80296d.slice/crio-56b0d2fca78bf62c1f34aa407cffb443a4f94ab87ba639ceee7c410105b0396c WatchSource:0}: Error finding container 56b0d2fca78bf62c1f34aa407cffb443a4f94ab87ba639ceee7c410105b0396c: Status 404 returned error can't find the container with id 56b0d2fca78bf62c1f34aa407cffb443a4f94ab87ba639ceee7c410105b0396c May 28 15:03:49.750868 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.750843 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59746bc44c-j996f"] May 28 15:03:49.754556 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.754537 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:49.757126 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.757104 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 28 15:03:49.762554 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.762532 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59746bc44c-j996f"] May 28 15:03:49.806767 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.806741 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt7dw\" (UniqueName: \"kubernetes.io/projected/192bd20c-ab93-4df6-828f-cf351d09e9d6-kube-api-access-qt7dw\") pod \"authorino-59746bc44c-j996f\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:49.806884 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.806791 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrsz\" (UniqueName: \"kubernetes.io/projected/9fa5a267-4966-4ab6-9184-4594c63a6663-kube-api-access-rnrsz\") pod \"authorino-768bffc59f-j5fpv\" (UID: \"9fa5a267-4966-4ab6-9184-4594c63a6663\") " pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:49.806884 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.806843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/192bd20c-ab93-4df6-828f-cf351d09e9d6-tls-cert\") pod \"authorino-59746bc44c-j996f\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:49.815777 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.815756 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrsz\" (UniqueName: \"kubernetes.io/projected/9fa5a267-4966-4ab6-9184-4594c63a6663-kube-api-access-rnrsz\") pod \"authorino-768bffc59f-j5fpv\" (UID: \"9fa5a267-4966-4ab6-9184-4594c63a6663\") " pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:49.908364 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.908267 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qt7dw\" (UniqueName: \"kubernetes.io/projected/192bd20c-ab93-4df6-828f-cf351d09e9d6-kube-api-access-qt7dw\") pod \"authorino-59746bc44c-j996f\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:49.908364 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.908362 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/192bd20c-ab93-4df6-828f-cf351d09e9d6-tls-cert\") pod \"authorino-59746bc44c-j996f\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:49.910724 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.910699 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/192bd20c-ab93-4df6-828f-cf351d09e9d6-tls-cert\") pod \"authorino-59746bc44c-j996f\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:49.915799 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:49.915780 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt7dw\" (UniqueName: \"kubernetes.io/projected/192bd20c-ab93-4df6-828f-cf351d09e9d6-kube-api-access-qt7dw\") pod \"authorino-59746bc44c-j996f\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:50.064910 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.064879 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:03:50.188631 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.188606 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59746bc44c-j996f"] May 28 15:03:50.195458 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:03:50.195434 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod192bd20c_ab93_4df6_828f_cf351d09e9d6.slice/crio-1ebeeef7074003c9d058b36ada09b9eefd512a39d9081599f0478ccee09270dd WatchSource:0}: Error finding container 1ebeeef7074003c9d058b36ada09b9eefd512a39d9081599f0478ccee09270dd: Status 404 returned error can't find the container with id 1ebeeef7074003c9d058b36ada09b9eefd512a39d9081599f0478ccee09270dd May 28 15:03:50.716979 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.716948 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59746bc44c-j996f" event={"ID":"192bd20c-ab93-4df6-828f-cf351d09e9d6","Type":"ContainerStarted","Data":"1ebeeef7074003c9d058b36ada09b9eefd512a39d9081599f0478ccee09270dd"} May 28 15:03:50.718170 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.718150 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:50.718264 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.718162 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" event={"ID":"c692b159-83b9-42dc-a514-418c4e80296d","Type":"ContainerStarted","Data":"fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0"} May 28 15:03:50.718264 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.718192 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" event={"ID":"c692b159-83b9-42dc-a514-418c4e80296d","Type":"ContainerStarted","Data":"56b0d2fca78bf62c1f34aa407cffb443a4f94ab87ba639ceee7c410105b0396c"} May 28 15:03:50.718264 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.718194 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" podUID="c692b159-83b9-42dc-a514-418c4e80296d" containerName="authorino" containerID="cri-o://fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0" gracePeriod=30 May 28 15:03:50.722876 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.722860 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:50.735127 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.735085 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" podStartSLOduration=1.306519397 podStartE2EDuration="1.735073338s" podCreationTimestamp="2026-05-28 15:03:49 +0000 UTC" firstStartedPulling="2026-05-28 15:03:49.739375304 +0000 UTC m=+677.706137046" lastFinishedPulling="2026-05-28 15:03:50.16792923 +0000 UTC m=+678.134690987" observedRunningTime="2026-05-28 15:03:50.73329294 +0000 UTC m=+678.700054706" watchObservedRunningTime="2026-05-28 15:03:50.735073338 +0000 UTC m=+678.701835102" May 28 15:03:50.818177 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.818144 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnrsz\" (UniqueName: \"kubernetes.io/projected/9fa5a267-4966-4ab6-9184-4594c63a6663-kube-api-access-rnrsz\") pod \"9fa5a267-4966-4ab6-9184-4594c63a6663\" (UID: \"9fa5a267-4966-4ab6-9184-4594c63a6663\") " May 28 15:03:50.820109 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.820084 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa5a267-4966-4ab6-9184-4594c63a6663-kube-api-access-rnrsz" (OuterVolumeSpecName: "kube-api-access-rnrsz") pod "9fa5a267-4966-4ab6-9184-4594c63a6663" (UID: "9fa5a267-4966-4ab6-9184-4594c63a6663"). InnerVolumeSpecName "kube-api-access-rnrsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:03:50.919150 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.919083 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnrsz\" (UniqueName: \"kubernetes.io/projected/9fa5a267-4966-4ab6-9184-4594c63a6663-kube-api-access-rnrsz\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:03:50.941803 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:50.941780 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:51.019668 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.019633 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8drkk\" (UniqueName: \"kubernetes.io/projected/c692b159-83b9-42dc-a514-418c4e80296d-kube-api-access-8drkk\") pod \"c692b159-83b9-42dc-a514-418c4e80296d\" (UID: \"c692b159-83b9-42dc-a514-418c4e80296d\") " May 28 15:03:51.021627 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.021604 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c692b159-83b9-42dc-a514-418c4e80296d-kube-api-access-8drkk" (OuterVolumeSpecName: "kube-api-access-8drkk") pod "c692b159-83b9-42dc-a514-418c4e80296d" (UID: "c692b159-83b9-42dc-a514-418c4e80296d"). InnerVolumeSpecName "kube-api-access-8drkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:03:51.120389 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.120341 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8drkk\" (UniqueName: \"kubernetes.io/projected/c692b159-83b9-42dc-a514-418c4e80296d-kube-api-access-8drkk\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:03:51.722858 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.722820 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59746bc44c-j996f" event={"ID":"192bd20c-ab93-4df6-828f-cf351d09e9d6","Type":"ContainerStarted","Data":"9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84"} May 28 15:03:51.723935 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.723906 2555 generic.go:358] "Generic (PLEG): container finished" podID="c692b159-83b9-42dc-a514-418c4e80296d" containerID="fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0" exitCode=0 May 28 15:03:51.724047 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.723946 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" May 28 15:03:51.724047 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.723965 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768bffc59f-j5fpv" May 28 15:03:51.724047 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.723992 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" event={"ID":"c692b159-83b9-42dc-a514-418c4e80296d","Type":"ContainerDied","Data":"fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0"} May 28 15:03:51.724047 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.724021 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-5vfzb" event={"ID":"c692b159-83b9-42dc-a514-418c4e80296d","Type":"ContainerDied","Data":"56b0d2fca78bf62c1f34aa407cffb443a4f94ab87ba639ceee7c410105b0396c"} May 28 15:03:51.724047 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.724034 2555 scope.go:117] "RemoveContainer" containerID="fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0" May 28 15:03:51.732750 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.732680 2555 scope.go:117] "RemoveContainer" containerID="fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0" May 28 15:03:51.733087 ip-10-0-131-234 kubenswrapper[2555]: E0528 15:03:51.733064 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0\": container with ID starting with fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0 not found: ID does not exist" containerID="fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0" May 28 15:03:51.733165 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.733097 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0"} err="failed to get container status \"fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0\": rpc error: code = NotFound desc = could not find container \"fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0\": container with ID starting with fe9b65b0ba4e3bb828798f10c9426e84504a805e21a2da1f4758567ec98fbae0 not found: ID does not exist" May 28 15:03:51.739054 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.739016 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-59746bc44c-j996f" podStartSLOduration=2.294234755 podStartE2EDuration="2.738995002s" podCreationTimestamp="2026-05-28 15:03:49 +0000 UTC" firstStartedPulling="2026-05-28 15:03:50.196624057 +0000 UTC m=+678.163385803" lastFinishedPulling="2026-05-28 15:03:50.641384307 +0000 UTC m=+678.608146050" observedRunningTime="2026-05-28 15:03:51.737652046 +0000 UTC m=+679.704413812" watchObservedRunningTime="2026-05-28 15:03:51.738995002 +0000 UTC m=+679.705756764" May 28 15:03:51.753009 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.752985 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5vfzb"] May 28 15:03:51.758650 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.758626 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5vfzb"] May 28 15:03:51.783655 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.783590 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768bffc59f-j5fpv"] May 28 15:03:51.785979 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:51.785952 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-768bffc59f-j5fpv"] May 28 15:03:52.640013 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:52.639978 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa5a267-4966-4ab6-9184-4594c63a6663" path="/var/lib/kubelet/pods/9fa5a267-4966-4ab6-9184-4594c63a6663/volumes" May 28 15:03:52.640212 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:03:52.640200 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c692b159-83b9-42dc-a514-418c4e80296d" path="/var/lib/kubelet/pods/c692b159-83b9-42dc-a514-418c4e80296d/volumes" May 28 15:05:52.370295 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.370212 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59746bc44c-j996f"] May 28 15:05:52.370819 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.370496 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-59746bc44c-j996f" podUID="192bd20c-ab93-4df6-828f-cf351d09e9d6" containerName="authorino" containerID="cri-o://9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84" gracePeriod=30 May 28 15:05:52.619557 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.619532 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:05:52.697059 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.696978 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt7dw\" (UniqueName: \"kubernetes.io/projected/192bd20c-ab93-4df6-828f-cf351d09e9d6-kube-api-access-qt7dw\") pod \"192bd20c-ab93-4df6-828f-cf351d09e9d6\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " May 28 15:05:52.697208 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.697061 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/192bd20c-ab93-4df6-828f-cf351d09e9d6-tls-cert\") pod \"192bd20c-ab93-4df6-828f-cf351d09e9d6\" (UID: \"192bd20c-ab93-4df6-828f-cf351d09e9d6\") " May 28 15:05:52.699021 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.698987 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192bd20c-ab93-4df6-828f-cf351d09e9d6-kube-api-access-qt7dw" (OuterVolumeSpecName: "kube-api-access-qt7dw") pod "192bd20c-ab93-4df6-828f-cf351d09e9d6" (UID: "192bd20c-ab93-4df6-828f-cf351d09e9d6"). InnerVolumeSpecName "kube-api-access-qt7dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:05:52.706730 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.706703 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/192bd20c-ab93-4df6-828f-cf351d09e9d6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "192bd20c-ab93-4df6-828f-cf351d09e9d6" (UID: "192bd20c-ab93-4df6-828f-cf351d09e9d6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 15:05:52.798006 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.797972 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt7dw\" (UniqueName: \"kubernetes.io/projected/192bd20c-ab93-4df6-828f-cf351d09e9d6-kube-api-access-qt7dw\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:05:52.798006 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:52.798000 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/192bd20c-ab93-4df6-828f-cf351d09e9d6-tls-cert\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:05:53.140001 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.139971 2555 generic.go:358] "Generic (PLEG): container finished" podID="192bd20c-ab93-4df6-828f-cf351d09e9d6" containerID="9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84" exitCode=0 May 28 15:05:53.140174 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.140018 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59746bc44c-j996f" May 28 15:05:53.140174 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.140019 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59746bc44c-j996f" event={"ID":"192bd20c-ab93-4df6-828f-cf351d09e9d6","Type":"ContainerDied","Data":"9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84"} May 28 15:05:53.140174 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.140121 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59746bc44c-j996f" event={"ID":"192bd20c-ab93-4df6-828f-cf351d09e9d6","Type":"ContainerDied","Data":"1ebeeef7074003c9d058b36ada09b9eefd512a39d9081599f0478ccee09270dd"} May 28 15:05:53.140174 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.140136 2555 scope.go:117] "RemoveContainer" containerID="9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84" May 28 15:05:53.148465 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.148448 2555 scope.go:117] "RemoveContainer" containerID="9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84" May 28 15:05:53.148693 ip-10-0-131-234 kubenswrapper[2555]: E0528 15:05:53.148676 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84\": container with ID starting with 9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84 not found: ID does not exist" containerID="9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84" May 28 15:05:53.148732 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.148703 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84"} err="failed to get container status \"9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84\": rpc error: code = NotFound desc = could not find container \"9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84\": container with ID starting with 9db3992ecd1dbf79b36e2afbf22d2853ef5f0306deae836cdd7f39a9cab74a84 not found: ID does not exist" May 28 15:05:53.160921 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.160896 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59746bc44c-j996f"] May 28 15:05:53.163924 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:53.163903 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59746bc44c-j996f"] May 28 15:05:54.640087 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:05:54.640052 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="192bd20c-ab93-4df6-828f-cf351d09e9d6" path="/var/lib/kubelet/pods/192bd20c-ab93-4df6-828f-cf351d09e9d6/volumes" May 28 15:07:23.589531 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.589453 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-z7d46"] May 28 15:07:23.589999 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.589870 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="192bd20c-ab93-4df6-828f-cf351d09e9d6" containerName="authorino" May 28 15:07:23.589999 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.589887 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="192bd20c-ab93-4df6-828f-cf351d09e9d6" containerName="authorino" May 28 15:07:23.589999 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.589907 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c692b159-83b9-42dc-a514-418c4e80296d" containerName="authorino" May 28 15:07:23.589999 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.589917 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c692b159-83b9-42dc-a514-418c4e80296d" containerName="authorino" May 28 15:07:23.590324 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.590006 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="c692b159-83b9-42dc-a514-418c4e80296d" containerName="authorino" May 28 15:07:23.590324 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.590019 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="192bd20c-ab93-4df6-828f-cf351d09e9d6" containerName="authorino" May 28 15:07:23.593366 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.593346 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.595911 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.595893 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2vzc\"" May 28 15:07:23.595994 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.595893 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 28 15:07:23.596953 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.596940 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" May 28 15:07:23.603851 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.603805 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-z7d46"] May 28 15:07:23.702453 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.702429 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkfcz\" (UniqueName: \"kubernetes.io/projected/a54747b1-f157-4dc0-a5a8-bc86d1864fa1-kube-api-access-bkfcz\") pod \"maas-controller-5c48cdb64c-z7d46\" (UID: \"a54747b1-f157-4dc0-a5a8-bc86d1864fa1\") " pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.702555 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.702460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a54747b1-f157-4dc0-a5a8-bc86d1864fa1-webhook-cert\") pod \"maas-controller-5c48cdb64c-z7d46\" (UID: \"a54747b1-f157-4dc0-a5a8-bc86d1864fa1\") " pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.803839 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.803811 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a54747b1-f157-4dc0-a5a8-bc86d1864fa1-webhook-cert\") pod \"maas-controller-5c48cdb64c-z7d46\" (UID: \"a54747b1-f157-4dc0-a5a8-bc86d1864fa1\") " pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.803974 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.803928 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkfcz\" (UniqueName: \"kubernetes.io/projected/a54747b1-f157-4dc0-a5a8-bc86d1864fa1-kube-api-access-bkfcz\") pod \"maas-controller-5c48cdb64c-z7d46\" (UID: \"a54747b1-f157-4dc0-a5a8-bc86d1864fa1\") " pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.806478 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.806445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a54747b1-f157-4dc0-a5a8-bc86d1864fa1-webhook-cert\") pod \"maas-controller-5c48cdb64c-z7d46\" (UID: \"a54747b1-f157-4dc0-a5a8-bc86d1864fa1\") " pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.812465 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.812441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkfcz\" (UniqueName: \"kubernetes.io/projected/a54747b1-f157-4dc0-a5a8-bc86d1864fa1-kube-api-access-bkfcz\") pod \"maas-controller-5c48cdb64c-z7d46\" (UID: \"a54747b1-f157-4dc0-a5a8-bc86d1864fa1\") " pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:23.919818 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:23.919753 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:24.050270 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:24.050247 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-z7d46"] May 28 15:07:24.052189 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:07:24.052159 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54747b1_f157_4dc0_a5a8_bc86d1864fa1.slice/crio-12852b84979155c444c0ba406d3f6ce7f96ff6c8dd1e7398b3c902489ff3ff7c WatchSource:0}: Error finding container 12852b84979155c444c0ba406d3f6ce7f96ff6c8dd1e7398b3c902489ff3ff7c: Status 404 returned error can't find the container with id 12852b84979155c444c0ba406d3f6ce7f96ff6c8dd1e7398b3c902489ff3ff7c May 28 15:07:24.053353 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:24.053335 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 15:07:24.456961 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:24.456922 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" event={"ID":"a54747b1-f157-4dc0-a5a8-bc86d1864fa1","Type":"ContainerStarted","Data":"12852b84979155c444c0ba406d3f6ce7f96ff6c8dd1e7398b3c902489ff3ff7c"} May 28 15:07:27.469822 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:27.469781 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" event={"ID":"a54747b1-f157-4dc0-a5a8-bc86d1864fa1","Type":"ContainerStarted","Data":"5e8b9eb56ae2b9157d7dceaeadb993e661dd7336b4487640fb41f27951557f94"} May 28 15:07:27.470218 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:27.469925 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:07:27.487300 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:27.487254 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" podStartSLOduration=1.574715217 podStartE2EDuration="4.487239987s" podCreationTimestamp="2026-05-28 15:07:23 +0000 UTC" firstStartedPulling="2026-05-28 15:07:24.05349135 +0000 UTC m=+892.020253093" lastFinishedPulling="2026-05-28 15:07:26.96601612 +0000 UTC m=+894.932777863" observedRunningTime="2026-05-28 15:07:27.485718923 +0000 UTC m=+895.452480690" watchObservedRunningTime="2026-05-28 15:07:27.487239987 +0000 UTC m=+895.454001806" May 28 15:07:38.479357 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:07:38.479327 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c48cdb64c-z7d46" May 28 15:15:00.134274 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.134237 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666355-8sgmp"] May 28 15:15:00.137807 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.137788 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:15:00.140060 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.140041 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xljxx\"" May 28 15:15:00.152421 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.152398 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666355-8sgmp"] May 28 15:15:00.222344 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.222288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkn8\" (UniqueName: \"kubernetes.io/projected/dca4cfee-bfbc-4ab0-9c15-13eca6959024-kube-api-access-zkkn8\") pod \"maas-api-key-cleanup-29666355-8sgmp\" (UID: \"dca4cfee-bfbc-4ab0-9c15-13eca6959024\") " pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:15:00.323807 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.323776 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkn8\" (UniqueName: \"kubernetes.io/projected/dca4cfee-bfbc-4ab0-9c15-13eca6959024-kube-api-access-zkkn8\") pod \"maas-api-key-cleanup-29666355-8sgmp\" (UID: \"dca4cfee-bfbc-4ab0-9c15-13eca6959024\") " pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:15:00.333047 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.333023 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkn8\" (UniqueName: \"kubernetes.io/projected/dca4cfee-bfbc-4ab0-9c15-13eca6959024-kube-api-access-zkkn8\") pod \"maas-api-key-cleanup-29666355-8sgmp\" (UID: \"dca4cfee-bfbc-4ab0-9c15-13eca6959024\") " pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:15:00.447524 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.447438 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:15:00.578032 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.578007 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666355-8sgmp"] May 28 15:15:00.580039 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:15:00.580009 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca4cfee_bfbc_4ab0_9c15_13eca6959024.slice/crio-afca78ef01fb2804356194eaf9aa2a1e7da37a0394ff8451301323eafae1d349 WatchSource:0}: Error finding container afca78ef01fb2804356194eaf9aa2a1e7da37a0394ff8451301323eafae1d349: Status 404 returned error can't find the container with id afca78ef01fb2804356194eaf9aa2a1e7da37a0394ff8451301323eafae1d349 May 28 15:15:00.581680 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:00.581664 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 15:15:01.033246 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:01.033210 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" event={"ID":"dca4cfee-bfbc-4ab0-9c15-13eca6959024","Type":"ContainerStarted","Data":"afca78ef01fb2804356194eaf9aa2a1e7da37a0394ff8451301323eafae1d349"} May 28 15:15:05.049222 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:05.049178 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" event={"ID":"dca4cfee-bfbc-4ab0-9c15-13eca6959024","Type":"ContainerStarted","Data":"9b974bfb7488fd671940f2bd4b796c129b710fe8f8fac626955f17bbbaccd2d8"} May 28 15:15:05.065367 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:05.065303 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" podStartSLOduration=1.345364826 podStartE2EDuration="5.065287863s" podCreationTimestamp="2026-05-28 15:15:00 +0000 UTC" firstStartedPulling="2026-05-28 15:15:00.581788574 +0000 UTC m=+1348.548550317" lastFinishedPulling="2026-05-28 15:15:04.301711607 +0000 UTC m=+1352.268473354" observedRunningTime="2026-05-28 15:15:05.063398622 +0000 UTC m=+1353.030160388" watchObservedRunningTime="2026-05-28 15:15:05.065287863 +0000 UTC m=+1353.032049627" May 28 15:15:06.054418 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:06.054383 2555 generic.go:358] "Generic (PLEG): container finished" podID="dca4cfee-bfbc-4ab0-9c15-13eca6959024" containerID="9b974bfb7488fd671940f2bd4b796c129b710fe8f8fac626955f17bbbaccd2d8" exitCode=0 May 28 15:15:06.055078 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:06.054467 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" event={"ID":"dca4cfee-bfbc-4ab0-9c15-13eca6959024","Type":"ContainerDied","Data":"9b974bfb7488fd671940f2bd4b796c129b710fe8f8fac626955f17bbbaccd2d8"} May 28 15:15:07.184858 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:07.184836 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:15:07.284232 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:07.284202 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkkn8\" (UniqueName: \"kubernetes.io/projected/dca4cfee-bfbc-4ab0-9c15-13eca6959024-kube-api-access-zkkn8\") pod \"dca4cfee-bfbc-4ab0-9c15-13eca6959024\" (UID: \"dca4cfee-bfbc-4ab0-9c15-13eca6959024\") " May 28 15:15:07.286350 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:07.286318 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca4cfee-bfbc-4ab0-9c15-13eca6959024-kube-api-access-zkkn8" (OuterVolumeSpecName: "kube-api-access-zkkn8") pod "dca4cfee-bfbc-4ab0-9c15-13eca6959024" (UID: "dca4cfee-bfbc-4ab0-9c15-13eca6959024"). InnerVolumeSpecName "kube-api-access-zkkn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 15:15:07.385223 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:07.385196 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkkn8\" (UniqueName: \"kubernetes.io/projected/dca4cfee-bfbc-4ab0-9c15-13eca6959024-kube-api-access-zkkn8\") on node \"ip-10-0-131-234.ec2.internal\" DevicePath \"\"" May 28 15:15:08.063262 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:08.063222 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" event={"ID":"dca4cfee-bfbc-4ab0-9c15-13eca6959024","Type":"ContainerDied","Data":"afca78ef01fb2804356194eaf9aa2a1e7da37a0394ff8451301323eafae1d349"} May 28 15:15:08.063262 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:08.063261 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afca78ef01fb2804356194eaf9aa2a1e7da37a0394ff8451301323eafae1d349" May 28 15:15:08.063501 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:15:08.063285 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666355-8sgmp" May 28 15:28:56.101917 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:56.101888 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666355-8sgmp_dca4cfee-bfbc-4ab0-9c15-13eca6959024/cleanup/0.log" May 28 15:28:56.225549 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:56.225506 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c48cdb64c-z7d46_a54747b1-f157-4dc0-a5a8-bc86d1864fa1/manager/0.log" May 28 15:28:56.742936 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:56.742907 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5d999694-qkswp_2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace/manager/0.log" May 28 15:28:58.440440 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:58.440404 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-dn9d8_9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451/manager/0.log" May 28 15:28:58.817995 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:58.817921 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kz8mr_280724fe-36c7-4940-8703-b2b913b94f10/registry-server/0.log" May 28 15:28:59.209489 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:59.209450 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kpr7w_b64124b8-0f84-4488-8cc7-efb72de64a33/manager/0.log" May 28 15:28:59.602675 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:28:59.602648 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6_5600f800-dce4-4aec-aa89-c883ab72c7bb/istio-proxy/0.log" May 28 15:29:00.121635 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:00.121590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-qn5wr_53eafebb-138d-4a3c-bbb6-d03e8017d9be/istio-proxy/0.log" May 28 15:29:00.367701 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:00.367675 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6569d6554b-xnz6j_1f0f9c27-07d9-45ff-96eb-931940286665/router/0.log" May 28 15:29:05.904768 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.904737 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-726pb/must-gather-ngtzr"] May 28 15:29:05.905203 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.905087 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca4cfee-bfbc-4ab0-9c15-13eca6959024" containerName="cleanup" May 28 15:29:05.905203 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.905098 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca4cfee-bfbc-4ab0-9c15-13eca6959024" containerName="cleanup" May 28 15:29:05.905203 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.905169 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="dca4cfee-bfbc-4ab0-9c15-13eca6959024" containerName="cleanup" May 28 15:29:05.908250 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.908234 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:05.911142 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.911114 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-726pb\"/\"default-dockercfg-dtrql\"" May 28 15:29:05.911290 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.911119 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726pb\"/\"openshift-service-ca.crt\"" May 28 15:29:05.911290 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.911198 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726pb\"/\"kube-root-ca.crt\"" May 28 15:29:05.926220 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.926197 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726pb/must-gather-ngtzr"] May 28 15:29:05.994173 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.994143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsr7f\" (UniqueName: \"kubernetes.io/projected/dfe5ea79-0a53-4e56-9796-5de34f94fef8-kube-api-access-vsr7f\") pod \"must-gather-ngtzr\" (UID: \"dfe5ea79-0a53-4e56-9796-5de34f94fef8\") " pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:05.994386 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:05.994193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfe5ea79-0a53-4e56-9796-5de34f94fef8-must-gather-output\") pod \"must-gather-ngtzr\" (UID: \"dfe5ea79-0a53-4e56-9796-5de34f94fef8\") " pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:06.095368 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.095329 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsr7f\" (UniqueName: \"kubernetes.io/projected/dfe5ea79-0a53-4e56-9796-5de34f94fef8-kube-api-access-vsr7f\") pod \"must-gather-ngtzr\" (UID: \"dfe5ea79-0a53-4e56-9796-5de34f94fef8\") " pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:06.095546 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.095412 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfe5ea79-0a53-4e56-9796-5de34f94fef8-must-gather-output\") pod \"must-gather-ngtzr\" (UID: \"dfe5ea79-0a53-4e56-9796-5de34f94fef8\") " pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:06.095737 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.095716 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfe5ea79-0a53-4e56-9796-5de34f94fef8-must-gather-output\") pod \"must-gather-ngtzr\" (UID: \"dfe5ea79-0a53-4e56-9796-5de34f94fef8\") " pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:06.103144 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.103123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsr7f\" (UniqueName: \"kubernetes.io/projected/dfe5ea79-0a53-4e56-9796-5de34f94fef8-kube-api-access-vsr7f\") pod \"must-gather-ngtzr\" (UID: \"dfe5ea79-0a53-4e56-9796-5de34f94fef8\") " pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:06.217670 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.217592 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726pb/must-gather-ngtzr" May 28 15:29:06.344050 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.344026 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726pb/must-gather-ngtzr"] May 28 15:29:06.346462 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:29:06.346435 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfe5ea79_0a53_4e56_9796_5de34f94fef8.slice/crio-d8931d3ed462832b285b97d32b9e46facf37db1838e11ac257a4e37e15fbb794 WatchSource:0}: Error finding container d8931d3ed462832b285b97d32b9e46facf37db1838e11ac257a4e37e15fbb794: Status 404 returned error can't find the container with id d8931d3ed462832b285b97d32b9e46facf37db1838e11ac257a4e37e15fbb794 May 28 15:29:06.348210 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.348194 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 15:29:06.965745 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:06.965707 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/must-gather-ngtzr" event={"ID":"dfe5ea79-0a53-4e56-9796-5de34f94fef8","Type":"ContainerStarted","Data":"d8931d3ed462832b285b97d32b9e46facf37db1838e11ac257a4e37e15fbb794"} May 28 15:29:07.972593 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:07.972554 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/must-gather-ngtzr" event={"ID":"dfe5ea79-0a53-4e56-9796-5de34f94fef8","Type":"ContainerStarted","Data":"7593f14d3ee5c137034facb0cf886f78572ba731885d432b0c0aad8461e35277"} May 28 15:29:07.973061 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:07.972961 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/must-gather-ngtzr" event={"ID":"dfe5ea79-0a53-4e56-9796-5de34f94fef8","Type":"ContainerStarted","Data":"69dbc02820d4cfdd0df21aab8fadfb0fdb39e5da5a476d6e9a27c8d07a571fd0"} May 28 15:29:07.990362 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:07.990291 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-726pb/must-gather-ngtzr" podStartSLOduration=2.109571226 podStartE2EDuration="2.990279566s" podCreationTimestamp="2026-05-28 15:29:05 +0000 UTC" firstStartedPulling="2026-05-28 15:29:06.348345615 +0000 UTC m=+2194.315107358" lastFinishedPulling="2026-05-28 15:29:07.229053955 +0000 UTC m=+2195.195815698" observedRunningTime="2026-05-28 15:29:07.987499541 +0000 UTC m=+2195.954261306" watchObservedRunningTime="2026-05-28 15:29:07.990279566 +0000 UTC m=+2195.957041330" May 28 15:29:08.822285 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:08.822256 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rxmjw_e282f7f3-eb8f-45f8-8f1c-de556e30a556/global-pull-secret-syncer/0.log" May 28 15:29:08.964947 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:08.964915 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dxv6d_0575fb3f-7adb-4c61-b3e9-37271e730c0b/konnectivity-agent/0.log" May 28 15:29:09.013080 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:09.013043 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-234.ec2.internal_b6ff3f21836bc88daa29afcf104c5cc9/haproxy/0.log" May 28 15:29:13.199474 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:13.199399 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-dn9d8_9a3a6b9b-d47f-4bcf-abc8-2389f3fcf451/manager/0.log" May 28 15:29:13.296847 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:13.296816 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kz8mr_280724fe-36c7-4940-8703-b2b913b94f10/registry-server/0.log" May 28 15:29:13.485622 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:13.485542 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kpr7w_b64124b8-0f84-4488-8cc7-efb72de64a33/manager/0.log" May 28 15:29:14.939048 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:14.938966 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-mzfcx_69b10f97-38a2-4cd7-b9b1-b9f43d0ed481/cluster-monitoring-operator/0.log" May 28 15:29:15.050937 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.050908 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75b7c86789-9qxbn_79322a11-2be0-4151-a787-673c9ff014eb/metrics-server/0.log" May 28 15:29:15.081403 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.081353 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-5nbt5_f1ec66f5-08ca-49c1-8124-2b1a186171bb/monitoring-plugin/0.log" May 28 15:29:15.267564 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.267480 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-th57l_10338103-c5eb-480b-b58a-86d8b1c9d28a/node-exporter/0.log" May 28 15:29:15.287292 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.287185 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-th57l_10338103-c5eb-480b-b58a-86d8b1c9d28a/kube-rbac-proxy/0.log" May 28 15:29:15.309623 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.309532 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-th57l_10338103-c5eb-480b-b58a-86d8b1c9d28a/init-textfile/0.log" May 28 15:29:15.412586 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.412557 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/prometheus/0.log" May 28 15:29:15.436058 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.436028 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/config-reloader/0.log" May 28 15:29:15.458418 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.458393 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/thanos-sidecar/0.log" May 28 15:29:15.477812 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.477783 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/kube-rbac-proxy-web/0.log" May 28 15:29:15.498575 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.498547 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/kube-rbac-proxy/0.log" May 28 15:29:15.527063 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.526983 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/kube-rbac-proxy-thanos/0.log" May 28 15:29:15.547300 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.547267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8fbc9cf4-302e-46b9-8fa0-ea98e0e4cf5d/init-config-reloader/0.log" May 28 15:29:15.621726 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.621692 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-f89x9_64120d4f-afa2-404d-bc3e-e14d09cd8d8a/prometheus-operator-admission-webhook/0.log" May 28 15:29:15.729361 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.729331 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b766ff6cc-xp4vp_3ccc0b65-d4fd-4aac-91f6-7f174affb4fe/thanos-query/0.log" May 28 15:29:15.749362 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.749332 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b766ff6cc-xp4vp_3ccc0b65-d4fd-4aac-91f6-7f174affb4fe/kube-rbac-proxy-web/0.log" May 28 15:29:15.775444 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.775419 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b766ff6cc-xp4vp_3ccc0b65-d4fd-4aac-91f6-7f174affb4fe/kube-rbac-proxy/0.log" May 28 15:29:15.826898 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.826869 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b766ff6cc-xp4vp_3ccc0b65-d4fd-4aac-91f6-7f174affb4fe/prom-label-proxy/0.log" May 28 15:29:15.851980 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.851932 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b766ff6cc-xp4vp_3ccc0b65-d4fd-4aac-91f6-7f174affb4fe/kube-rbac-proxy-rules/0.log" May 28 15:29:15.871283 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:15.871248 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b766ff6cc-xp4vp_3ccc0b65-d4fd-4aac-91f6-7f174affb4fe/kube-rbac-proxy-metrics/0.log" May 28 15:29:17.416761 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.416726 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz"] May 28 15:29:17.422852 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.422822 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.429497 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.429448 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz"] May 28 15:29:17.519576 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.519534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-sys\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.519764 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.519598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbhn\" (UniqueName: \"kubernetes.io/projected/f06718eb-ab97-4176-841a-661d4249062f-kube-api-access-2kbhn\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.519764 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.519657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-proc\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.519764 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.519679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-lib-modules\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.519764 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.519720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-podres\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621113 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621070 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-sys\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621290 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621133 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbhn\" (UniqueName: \"kubernetes.io/projected/f06718eb-ab97-4176-841a-661d4249062f-kube-api-access-2kbhn\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621290 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621195 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-proc\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621290 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621216 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-lib-modules\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621290 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621263 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-podres\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621508 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621477 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-podres\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621567 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621542 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-sys\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621782 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621757 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-proc\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.621878 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.621836 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06718eb-ab97-4176-841a-661d4249062f-lib-modules\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.630648 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.630599 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbhn\" (UniqueName: \"kubernetes.io/projected/f06718eb-ab97-4176-841a-661d4249062f-kube-api-access-2kbhn\") pod \"perf-node-gather-daemonset-tflxz\" (UID: \"f06718eb-ab97-4176-841a-661d4249062f\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.738780 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.738680 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:17.914547 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:17.913432 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz"] May 28 15:29:17.915381 ip-10-0-131-234 kubenswrapper[2555]: W0528 15:29:17.915351 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf06718eb_ab97_4176_841a_661d4249062f.slice/crio-f56acc8dc67e5cf1d44453d3a06228ec65e7b33f7ad5d2df6200b824f47a63b5 WatchSource:0}: Error finding container f56acc8dc67e5cf1d44453d3a06228ec65e7b33f7ad5d2df6200b824f47a63b5: Status 404 returned error can't find the container with id f56acc8dc67e5cf1d44453d3a06228ec65e7b33f7ad5d2df6200b824f47a63b5 May 28 15:29:18.018131 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:18.018056 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" event={"ID":"f06718eb-ab97-4176-841a-661d4249062f","Type":"ContainerStarted","Data":"f56acc8dc67e5cf1d44453d3a06228ec65e7b33f7ad5d2df6200b824f47a63b5"} May 28 15:29:18.620888 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:18.620859 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-w9c2k_d81e70ae-22b0-4064-b389-fc9fa7c44924/volume-data-source-validator/0.log" May 28 15:29:19.023022 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:19.022931 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" event={"ID":"f06718eb-ab97-4176-841a-661d4249062f","Type":"ContainerStarted","Data":"a978cb8b683ea441e75340f7008997c5a193806577f7b3e1c97ce727dd77bf40"} May 28 15:29:19.023181 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:19.023066 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:19.043231 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:19.043165 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" podStartSLOduration=2.043146257 podStartE2EDuration="2.043146257s" podCreationTimestamp="2026-05-28 15:29:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:29:19.041683422 +0000 UTC m=+2207.008445190" watchObservedRunningTime="2026-05-28 15:29:19.043146257 +0000 UTC m=+2207.009908023" May 28 15:29:19.622150 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:19.622109 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2xxq_1d5c5c98-be38-4857-9844-ab5321c762b5/dns/0.log" May 28 15:29:19.657838 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:19.657811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2xxq_1d5c5c98-be38-4857-9844-ab5321c762b5/kube-rbac-proxy/0.log" May 28 15:29:19.741443 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:19.741410 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9xjw2_362fcd77-1677-4840-830d-b27bf923a874/dns-node-resolver/0.log" May 28 15:29:20.373326 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:20.373272 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98jws_7b178de4-ff32-4f71-ace9-fd0ae3e26280/node-ca/0.log" May 28 15:29:21.292638 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:21.292611 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b2bmw6_5600f800-dce4-4aec-aa89-c883ab72c7bb/istio-proxy/0.log" May 28 15:29:21.596206 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:21.596182 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-qn5wr_53eafebb-138d-4a3c-bbb6-d03e8017d9be/istio-proxy/0.log" May 28 15:29:21.710287 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:21.710260 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6569d6554b-xnz6j_1f0f9c27-07d9-45ff-96eb-931940286665/router/0.log" May 28 15:29:22.226538 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:22.226513 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4m795_d0c535af-3f69-47c1-8395-c245d1726748/serve-healthcheck-canary/0.log" May 28 15:29:22.710412 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:22.710374 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-r4m86_3474f9e0-ce25-473b-b7e9-51882fcce751/insights-operator/0.log" May 28 15:29:22.712073 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:22.712043 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-r4m86_3474f9e0-ce25-473b-b7e9-51882fcce751/insights-operator/1.log" May 28 15:29:22.735481 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:22.735459 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ct7gm_f59c8292-8dc2-49c6-85c7-f325ce46ab16/kube-rbac-proxy/0.log" May 28 15:29:22.758051 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:22.758026 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ct7gm_f59c8292-8dc2-49c6-85c7-f325ce46ab16/exporter/0.log" May 28 15:29:22.779276 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:22.779257 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ct7gm_f59c8292-8dc2-49c6-85c7-f325ce46ab16/extractor/0.log" May 28 15:29:24.862538 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:24.862511 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666355-8sgmp_dca4cfee-bfbc-4ab0-9c15-13eca6959024/cleanup/0.log" May 28 15:29:24.941264 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:24.941232 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c48cdb64c-z7d46_a54747b1-f157-4dc0-a5a8-bc86d1864fa1/manager/0.log" May 28 15:29:25.036890 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:25.036866 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-tflxz" May 28 15:29:25.078490 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:25.078461 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5d999694-qkswp_2e5ca4da-a2dd-42cf-b0e5-904dd25c2ace/manager/0.log" May 28 15:29:26.369062 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:26.369034 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64f64c6b7b-lggcj_35f13e6f-20e8-4816-8310-edc540945966/manager/0.log" May 28 15:29:30.686872 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:30.686841 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-gl7sw_3b5284ee-5988-4f92-86a3-3aa4135c10d0/migrator/0.log" May 28 15:29:30.706436 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:30.706397 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-gl7sw_3b5284ee-5988-4f92-86a3-3aa4135c10d0/graceful-termination/0.log" May 28 15:29:31.055960 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:31.055891 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-bpxpp_924b2db9-2aa0-4071-a020-93dda946a96a/kube-storage-version-migrator-operator/1.log" May 28 15:29:31.056863 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:31.056846 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-bpxpp_924b2db9-2aa0-4071-a020-93dda946a96a/kube-storage-version-migrator-operator/0.log" May 28 15:29:32.357743 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.357712 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/kube-multus-additional-cni-plugins/0.log" May 28 15:29:32.378094 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.378064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/egress-router-binary-copy/0.log" May 28 15:29:32.399567 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.399545 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/cni-plugins/0.log" May 28 15:29:32.419085 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.419063 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/bond-cni-plugin/0.log" May 28 15:29:32.438955 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.438928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/routeoverride-cni/0.log" May 28 15:29:32.458177 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.458144 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/whereabouts-cni-bincopy/0.log" May 28 15:29:32.477453 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.477426 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tm9sx_684b1ef2-da7c-4408-8a57-9cd9f8ce01a0/whereabouts-cni/0.log" May 28 15:29:32.576570 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.576545 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vn94b_0746c2c7-a3d7-47bb-8cf4-b8f6425693f3/kube-multus/0.log" May 28 15:29:32.596120 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.596096 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qbj7c_966e40a6-12aa-4008-af5e-79ad1884aa83/network-metrics-daemon/0.log" May 28 15:29:32.615689 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:32.615635 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qbj7c_966e40a6-12aa-4008-af5e-79ad1884aa83/kube-rbac-proxy/0.log" May 28 15:29:33.502364 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.502339 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/ovn-controller/0.log" May 28 15:29:33.533037 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.533009 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/ovn-acl-logging/0.log" May 28 15:29:33.553420 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.553384 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/kube-rbac-proxy-node/0.log" May 28 15:29:33.578193 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.578163 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/kube-rbac-proxy-ovn-metrics/0.log" May 28 15:29:33.594391 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.594361 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/northd/0.log" May 28 15:29:33.623869 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.623844 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/nbdb/0.log" May 28 15:29:33.644705 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.644685 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/sbdb/0.log" May 28 15:29:33.753545 ip-10-0-131-234 kubenswrapper[2555]: I0528 15:29:33.753470 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n5w8_3ab3d5a3-ed04-40cd-b0d9-1d9a8b36cdc5/ovnkube-controller/0.log"