Jun 09 00:19:47.832792 ip-10-0-140-224 systemd[1]: Starting Kubernetes Kubelet... Jun 09 00:19:48.238251 ip-10-0-140-224 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 00:19:48.238251 ip-10-0-140-224 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 00:19:48.238251 ip-10-0-140-224 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 00:19:48.238251 ip-10-0-140-224 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 00:19:48.238745 ip-10-0-140-224 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 00:19:48.238745 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.238307 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 00:19:48.242823 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242808 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.242823 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242821 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.242823 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242825 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242828 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242832 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242835 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242838 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242840 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242843 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242846 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242849 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242857 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242859 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242862 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242865 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242867 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242870 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242872 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242875 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242877 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242880 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242882 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242885 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.242912 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242887 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242890 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242892 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242895 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242897 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242900 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242902 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242904 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242906 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242909 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242911 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242914 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242916 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242919 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242922 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242925 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242927 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242929 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242932 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242935 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.243389 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242937 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242940 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242943 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242945 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242947 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242950 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242952 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242954 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242956 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242958 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242961 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242963 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242965 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242968 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242971 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242974 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242976 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242979 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242981 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.243863 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242984 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242988 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242991 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242994 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242997 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.242999 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243002 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243005 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243007 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243010 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243012 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243015 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243017 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243020 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243022 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243029 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243031 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243034 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243036 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.244310 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243039 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243041 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243046 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243049 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243052 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243055 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243057 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243059 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243063 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243066 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243068 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243071 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243073 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243076 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243080 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243082 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243085 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.244753 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.243088 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.246179 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246167 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.246179 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246179 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246182 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246185 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246188 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246191 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246194 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246197 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246200 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246202 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246205 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246208 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246210 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246212 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246215 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246217 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246220 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246222 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246225 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246227 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246229 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.246235 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246232 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246234 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246236 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246239 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246242 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246244 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246247 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246250 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246252 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246255 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246257 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246259 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246262 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246265 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246268 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246274 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246278 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246281 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246283 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246285 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.246764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246288 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246290 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246292 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246295 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246297 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246300 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246302 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246304 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246307 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246309 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246312 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246314 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246316 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246318 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246322 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246324 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246327 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246329 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246331 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246334 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.247489 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246336 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246339 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246341 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246344 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246346 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246348 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246350 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246354 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246359 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246362 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246365 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246368 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246370 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246373 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246375 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246378 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246380 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246383 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246385 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.247997 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246387 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246390 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246392 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246394 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246397 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246400 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246402 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246405 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246407 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246410 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246412 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246415 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246417 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246419 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246422 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246424 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246426 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246429 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.246431 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.248445 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248252 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248263 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248267 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248270 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248274 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248277 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248280 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248283 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248287 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248290 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248293 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248296 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248299 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248301 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248304 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248306 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248308 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248311 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248313 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.248920 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248316 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248318 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248321 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248323 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248325 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248328 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248331 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248334 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248337 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248339 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248341 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248344 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248346 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248348 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248351 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248354 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248356 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248359 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248361 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248363 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.249346 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248365 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248368 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248370 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248373 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248375 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248377 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248380 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248382 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248384 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248386 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248389 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248393 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248395 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248398 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248400 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248402 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248405 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248407 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248421 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248424 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.249825 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248426 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248429 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248431 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248434 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248436 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248439 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248441 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248444 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248447 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248449 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248452 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248455 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248459 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248461 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248464 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248466 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248469 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248472 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248474 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248476 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.250290 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248479 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248481 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248483 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248486 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248489 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248493 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248496 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248499 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248502 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248505 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248507 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248510 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248513 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248515 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248518 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248520 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248522 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248525 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248530 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.250802 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.248533 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248627 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248634 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248640 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248645 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248649 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248652 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248656 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248659 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248662 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248665 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248669 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248674 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248678 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248683 2572 flags.go:64] FLAG: --cgroup-root="" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248686 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248689 2572 flags.go:64] FLAG: --client-ca-file="" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248691 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248695 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248699 2572 flags.go:64] FLAG: --cluster-domain="" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248701 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248704 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248708 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248711 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 00:19:48.251250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248714 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248717 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248720 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248723 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248726 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248729 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248731 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248736 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248739 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248742 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248745 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248748 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248751 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248753 2572 flags.go:64] FLAG: --enable-server="true" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248756 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248760 2572 flags.go:64] FLAG: --event-burst="100" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248763 2572 flags.go:64] FLAG: --event-qps="50" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248766 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248768 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248771 2572 flags.go:64] FLAG: --eviction-hard="" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248774 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248777 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248780 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248783 2572 flags.go:64] FLAG: --eviction-soft="" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248785 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 00:19:48.251804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248788 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248790 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248794 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248797 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248799 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248803 2572 flags.go:64] FLAG: --feature-gates="" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248806 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248809 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248812 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248815 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248817 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248820 2572 flags.go:64] FLAG: --help="false" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248823 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248826 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248830 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248833 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248836 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248839 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248842 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248845 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248847 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248850 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248853 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248856 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 00:19:48.252383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248859 2572 flags.go:64] FLAG: --kube-reserved="" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248862 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248864 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248867 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248870 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248872 2572 flags.go:64] FLAG: --lock-file="" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248875 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248877 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248881 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248886 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248888 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248897 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248900 2572 flags.go:64] FLAG: --logging-format="text" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248903 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248906 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248909 2572 flags.go:64] FLAG: --manifest-url="" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248911 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248919 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248922 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248926 2572 flags.go:64] FLAG: --max-pods="110" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248929 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248932 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248937 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248940 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248942 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 00:19:48.252972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248945 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248948 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248958 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248961 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248964 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248967 2572 flags.go:64] FLAG: --pod-cidr="" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248970 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248974 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248977 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248980 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248983 2572 flags.go:64] FLAG: --port="10250" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248985 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248988 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08742514d5e17c255" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248991 2572 flags.go:64] FLAG: --qos-reserved="" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248994 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.248997 2572 flags.go:64] FLAG: --register-node="true" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249000 2572 flags.go:64] FLAG: --register-with-taints="" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249003 2572 flags.go:64] FLAG: --registry-burst="10" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249005 2572 flags.go:64] FLAG: --registry-qps="5" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249008 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249011 2572 flags.go:64] FLAG: --reserved-memory="" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249014 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249017 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249020 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249022 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 00:19:48.253545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249025 2572 flags.go:64] FLAG: --runonce="false" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249028 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249030 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249033 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249037 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249040 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249043 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249046 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249048 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249051 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249054 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249056 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249059 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249062 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249064 2572 flags.go:64] FLAG: --system-cgroups="" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249067 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249072 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249074 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249077 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249081 2572 flags.go:64] FLAG: --tls-min-version="" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249084 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249086 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249089 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249092 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249094 2572 flags.go:64] FLAG: --v="2" Jun 09 00:19:48.254180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249098 2572 flags.go:64] FLAG: --version="false" Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249101 2572 flags.go:64] FLAG: --vmodule="" Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249105 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.249108 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249216 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249219 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249222 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249225 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249227 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249230 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249233 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249237 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249239 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249242 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249245 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249248 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249250 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249253 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249256 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249258 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.254869 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249261 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249263 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249265 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249268 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249270 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249272 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249275 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249277 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249279 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249282 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249286 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249289 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249292 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249295 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249297 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249300 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249303 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249306 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249308 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249311 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.255340 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249313 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249316 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249318 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249322 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249324 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249326 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249329 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249331 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249334 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249336 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249339 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249341 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249343 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249346 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249348 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249351 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249354 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249356 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249359 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.255806 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249361 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249363 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249366 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249369 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249372 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249376 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249379 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249382 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249384 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249387 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249390 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249392 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249395 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249397 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249400 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249402 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249405 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249408 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249410 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.256233 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249413 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249415 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249418 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249420 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249422 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249425 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249427 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249430 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249432 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249435 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249437 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249439 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249442 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249444 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249447 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249449 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249452 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249456 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249459 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249463 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.256722 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249465 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249468 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249470 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249473 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.249475 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.250147 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.255501 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.255515 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.255533 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.255538 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255602 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255608 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255611 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255614 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255617 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.257183 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255620 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255623 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255625 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255627 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255630 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255632 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255635 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255637 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255640 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255642 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255645 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255647 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255650 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255652 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255656 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255659 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255662 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255665 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255668 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.257542 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255670 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255673 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255675 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255678 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255680 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255684 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255687 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255689 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255691 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255694 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255696 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255699 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255701 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255704 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255706 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255708 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255711 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255713 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255715 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255718 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.257991 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255720 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255722 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255725 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255727 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255730 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255732 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255735 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255737 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255739 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255742 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255744 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255746 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255749 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255751 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255753 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255756 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255758 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255761 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255764 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.258487 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255766 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255769 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255771 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255773 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255776 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255778 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255780 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255783 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255785 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255787 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255790 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255792 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255794 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255797 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255799 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255801 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255804 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255806 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255809 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255811 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.258944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255814 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255817 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255819 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255822 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255825 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255829 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255831 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255834 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255836 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255839 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255843 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255846 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255849 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255851 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255854 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.259433 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255857 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.255861 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255962 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255966 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255969 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255972 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255974 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255977 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255979 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255982 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255984 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255986 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255989 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255991 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255993 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 00:19:48.259844 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255996 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.255998 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256000 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256003 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256005 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256008 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256010 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256012 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256015 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256017 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256020 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256024 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256026 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256029 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256031 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256034 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256036 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256039 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256041 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256043 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 00:19:48.260191 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256045 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256048 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256050 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256053 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256055 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256057 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256060 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256062 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256065 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256067 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256069 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256072 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256074 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256076 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256079 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256081 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256084 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256086 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256089 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256091 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 00:19:48.260678 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256093 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256096 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256098 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256101 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256103 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256105 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256108 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256112 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256115 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256118 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256122 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256124 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256127 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256129 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256132 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256134 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256136 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256139 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256141 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 00:19:48.261130 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256143 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256146 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256148 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256151 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256153 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256156 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256158 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256160 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256162 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256165 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256168 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256170 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256172 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256175 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256177 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256180 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256182 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256184 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256187 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256189 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 00:19:48.261567 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256192 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256194 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256197 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256199 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256201 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256204 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:48.256206 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.256210 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.256294 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.258153 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.259468 2572 server.go:1019] "Starting client certificate rotation" Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.259575 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 00:19:48.262019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.259608 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 00:19:48.262305 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.262073 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 00:19:48.263127 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.263110 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 00:19:48.273811 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.273794 2572 log.go:25] "Validated CRI v1 runtime API" Jun 09 00:19:48.276006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.275987 2572 log.go:25] "Validated CRI v1 image API" Jun 09 00:19:48.277456 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.277442 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 00:19:48.280172 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.280155 2572 fs.go:135] Filesystem UUIDs: map[48c52a8c-1510-4942-a178-34c8537fac86:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a1b329ac-a269-4ae1-b722-1db120c9a38b:/dev/nvme0n1p3] Jun 09 00:19:48.280229 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.280172 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 00:19:48.285685 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.285588 2572 manager.go:216] Machine: {Timestamp:2026-06-09 00:19:48.284448781 +0000 UTC m=+0.332176208 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3313444 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201e6a6dafe6455f4bde4789911615 SystemUUID:ec201e6a-6daf-e645-5f4b-de4789911615 BootID:20da2e73-3ebe-40ec-ac4e-6994516a65dd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:03:46:75:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:03:46:75:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:24:71:93:04:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 00:19:48.285685 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.285682 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 00:19:48.285793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.285744 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 00:19:48.286545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.286531 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 00:19:48.288735 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.288717 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 00:19:48.288854 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.288738 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 00:19:48.290021 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.290012 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 00:19:48.290057 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.290025 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 00:19:48.290057 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.290032 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 00:19:48.290752 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.290741 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 00:19:48.291524 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.291515 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 00:19:48.294197 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294187 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 09 00:19:48.294296 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294288 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 00:19:48.294328 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294312 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 09 00:19:48.294328 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294328 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 00:19:48.294398 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294343 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 00:19:48.294398 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294352 2572 kubelet.go:398] "Adding apiserver pod source" Jun 09 00:19:48.294398 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294361 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 00:19:48.294643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294632 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 00:19:48.294682 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.294648 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 00:19:48.296905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.296892 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 00:19:48.298024 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.298011 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 00:19:48.298076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.298040 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 00:19:48.299953 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299941 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 00:19:48.299997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299961 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 00:19:48.299997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299966 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 00:19:48.299997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299972 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 00:19:48.299997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299979 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 00:19:48.299997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299984 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 00:19:48.299997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.299992 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 00:19:48.300152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.300003 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 00:19:48.300152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.300010 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 00:19:48.300152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.300015 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 00:19:48.300152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.300026 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 00:19:48.300152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.300031 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 00:19:48.301315 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.301305 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 00:19:48.301315 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.301314 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 00:19:48.303962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.303950 2572 server.go:1268] "Started kubelet" Jun 09 00:19:48.304060 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.304015 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 00:19:48.304119 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.304079 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 00:19:48.304596 ip-10-0-140-224 systemd[1]: Started Kubernetes Kubelet. Jun 09 00:19:48.308072 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.308040 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 00:19:48.308273 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.308254 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 00:19:48.308647 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.308618 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 00:19:48.308647 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.308621 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 00:19:48.308776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.308723 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 00:19:48.311535 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.311515 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 09 00:19:48.314031 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.312946 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-224.ec2.internal.18b741acda79f4ea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-224.ec2.internal,UID:ip-10-0-140-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-224.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.303926506 +0000 UTC m=+0.351653932,LastTimestamp:2026-06-09 00:19:48.303926506 +0000 UTC m=+0.351653932,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-224.ec2.internal,}" Jun 09 00:19:48.314803 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.314753 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 00:19:48.315067 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.315052 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 00:19:48.315145 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.315133 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 00:19:48.315543 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.315520 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.316019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316002 2572 factory.go:55] Registering systemd factory Jun 09 00:19:48.316098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316037 2572 factory.go:223] Registration of the systemd container factory successfully Jun 09 00:19:48.316098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316005 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 00:19:48.316098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316005 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 00:19:48.316098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316090 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 00:19:48.316269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316200 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 09 00:19:48.316269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316209 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 09 00:19:48.316339 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316273 2572 factory.go:153] Registering CRI-O factory Jun 09 00:19:48.316339 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316284 2572 factory.go:223] Registration of the crio container factory successfully Jun 09 00:19:48.316339 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316329 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 00:19:48.316433 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316358 2572 factory.go:103] Registering Raw factory Jun 09 00:19:48.316433 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316372 2572 manager.go:1196] Started watching for new ooms in manager Jun 09 00:19:48.316910 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.316892 2572 manager.go:349] Starting recovery of all containers Jun 09 00:19:48.320024 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.320002 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 00:19:48.320169 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.320096 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 00:19:48.326659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.326517 2572 manager.go:354] Recovery completed Jun 09 00:19:48.331188 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.331177 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.332954 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.332939 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q79xs" Jun 09 00:19:48.333507 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.333489 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.333591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.333520 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.333591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.333535 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.334042 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334026 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 00:19:48.334042 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334043 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 00:19:48.334145 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334057 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 09 00:19:48.334145 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334030 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.334814 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334799 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.334879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334827 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.334879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.334840 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.335147 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.335133 2572 policy_none.go:49] "None policy: Start" Jun 09 00:19:48.335221 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.335152 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 00:19:48.335221 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.335164 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 00:19:48.335221 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.335147 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-224.ec2.internal.18b741acdc3d48de default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-224.ec2.internal,UID:ip-10-0-140-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-224.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.333504734 +0000 UTC m=+0.381232171,LastTimestamp:2026-06-09 00:19:48.333504734 +0000 UTC m=+0.381232171,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-224.ec2.internal,}" Jun 09 00:19:48.336206 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.336195 2572 policy_none.go:47] "Start" Jun 09 00:19:48.340730 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.340714 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q79xs" Jun 09 00:19:48.343942 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.343886 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-224.ec2.internal.18b741acdc3da22d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-224.ec2.internal,UID:ip-10-0-140-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-224.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-224.ec2.internal,},FirstTimestamp:2026-06-09 00:19:48.333527597 +0000 UTC m=+0.381255030,LastTimestamp:2026-06-09 00:19:48.333527597 +0000 UTC m=+0.381255030,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-224.ec2.internal,}" Jun 09 00:19:48.368095 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368078 2572 manager.go:337] "Starting Device Plugin manager" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.368112 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368124 2572 server.go:87] "Starting device plugin registration server" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368300 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368309 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368394 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368462 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.368467 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.368965 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.369000 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.375794 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.376899 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.376927 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.376942 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 00:19:48.378712 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.376967 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 00:19:48.379176 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.378908 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:48.468764 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.468731 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.469488 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.469473 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.469574 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.469502 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.469574 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.469517 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.469574 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.469546 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.476103 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.476089 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.476173 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.476107 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-224.ec2.internal\": node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.477179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.477166 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal"] Jun 09 00:19:48.477218 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.477210 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.477856 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.477843 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.477901 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.477867 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.477901 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.477875 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.478981 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.478968 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.479096 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479080 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.479168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479114 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.479665 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479645 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.479665 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479666 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.479797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479679 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.479797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479732 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.479797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479758 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.479797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.479770 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.480782 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.480766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.480869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.480804 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:48.481381 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.481357 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:48.481381 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.481383 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:48.481508 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.481396 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:48.504134 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.504093 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-224.ec2.internal\" not found" node="ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.504966 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.504951 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.508392 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.508379 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-224.ec2.internal\" not found" node="ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.517329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.517312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc2317c6ca6ce2c8715a52a78254c178-config\") pod \"kube-apiserver-proxy-ip-10-0-140-224.ec2.internal\" (UID: \"fc2317c6ca6ce2c8715a52a78254c178\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.517383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.517334 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2a1b68d42b5a5bdd530bb75ef5c66ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal\" (UID: \"d2a1b68d42b5a5bdd530bb75ef5c66ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.517383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.517349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2a1b68d42b5a5bdd530bb75ef5c66ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal\" (UID: \"d2a1b68d42b5a5bdd530bb75ef5c66ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.605778 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.605757 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.617895 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.617873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2a1b68d42b5a5bdd530bb75ef5c66ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal\" (UID: \"d2a1b68d42b5a5bdd530bb75ef5c66ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.617968 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.617898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2a1b68d42b5a5bdd530bb75ef5c66ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal\" (UID: \"d2a1b68d42b5a5bdd530bb75ef5c66ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.617968 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.617914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc2317c6ca6ce2c8715a52a78254c178-config\") pod \"kube-apiserver-proxy-ip-10-0-140-224.ec2.internal\" (UID: \"fc2317c6ca6ce2c8715a52a78254c178\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.617968 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.617949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc2317c6ca6ce2c8715a52a78254c178-config\") pod \"kube-apiserver-proxy-ip-10-0-140-224.ec2.internal\" (UID: \"fc2317c6ca6ce2c8715a52a78254c178\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.618085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.617971 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2a1b68d42b5a5bdd530bb75ef5c66ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal\" (UID: \"d2a1b68d42b5a5bdd530bb75ef5c66ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.618085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.617991 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2a1b68d42b5a5bdd530bb75ef5c66ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal\" (UID: \"d2a1b68d42b5a5bdd530bb75ef5c66ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.706713 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.706688 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.807461 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.807420 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:48.808510 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.808498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.813037 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:48.812968 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" Jun 09 00:19:48.908253 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:48.908226 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.008807 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.008783 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.109384 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.109331 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.209933 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.209911 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.259410 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.259386 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 00:19:49.259868 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.259505 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 00:19:49.310387 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.310358 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.342979 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.342942 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 00:14:48 +0000 UTC" deadline="2027-11-22 20:10:33.672254498 +0000 UTC" Jun 09 00:19:49.342979 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.342976 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12763h50m44.329282629s" Jun 09 00:19:49.389459 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:49.389439 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2317c6ca6ce2c8715a52a78254c178.slice/crio-4cd94cc91a7c54974d35f92ac6485432733aa95ec29f9b647c0e46ac67c90293 WatchSource:0}: Error finding container 4cd94cc91a7c54974d35f92ac6485432733aa95ec29f9b647c0e46ac67c90293: Status 404 returned error can't find the container with id 4cd94cc91a7c54974d35f92ac6485432733aa95ec29f9b647c0e46ac67c90293 Jun 09 00:19:49.389893 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:49.389871 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a1b68d42b5a5bdd530bb75ef5c66ef.slice/crio-0970dd5c086e007532f2e9602bb0f19c76c9e0ea80b8b5ceeef02593407b5d20 WatchSource:0}: Error finding container 0970dd5c086e007532f2e9602bb0f19c76c9e0ea80b8b5ceeef02593407b5d20: Status 404 returned error can't find the container with id 0970dd5c086e007532f2e9602bb0f19c76c9e0ea80b8b5ceeef02593407b5d20 Jun 09 00:19:49.396306 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.396287 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 00:19:49.396830 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.396812 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:19:49.397463 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.397444 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientMemory" Jun 09 00:19:49.397500 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.397469 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 00:19:49.397500 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.397479 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeHasSufficientPID" Jun 09 00:19:49.411092 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.411075 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.494056 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.494039 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:49.511684 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.511667 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.612247 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.612225 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.712813 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.712787 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.813618 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:49.813592 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-224.ec2.internal\" not found" Jun 09 00:19:49.826246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.826222 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:49.870208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.870186 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:49.916078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.916061 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" Jun 09 00:19:49.927097 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.927081 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 00:19:49.928148 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.928134 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" Jun 09 00:19:49.935471 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:49.935456 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 00:19:50.064630 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.064574 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 00:19:50.295201 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.295177 2572 apiserver.go:52] "Watching apiserver" Jun 09 00:19:50.301041 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.301019 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 00:19:50.301387 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.301364 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dw7jh","kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk","openshift-dns/node-resolver-7nxx4","openshift-multus/multus-additional-cni-plugins-r6mhg","openshift-multus/multus-rh9f6","openshift-multus/network-metrics-daemon-7gn4s","openshift-network-diagnostics/network-check-target-2ln75","kube-system/konnectivity-agent-dxfsd","openshift-cluster-node-tuning-operator/tuned-6qqz9","openshift-image-registry/node-ca-65qx9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal","openshift-network-operator/iptables-alerter-6wskc","openshift-ovn-kubernetes/ovnkube-node-qm6wc"] Jun 09 00:19:50.302997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.302975 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.303106 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.303057 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:19:50.304363 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.304343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.305577 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.305528 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.306783 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.306729 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.306783 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.306774 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 00:19:50.306926 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.306742 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.306926 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.306800 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qc9p5\"" Jun 09 00:19:50.307024 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.306987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.308015 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.307902 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 00:19:50.308015 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.307905 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.308144 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.308035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.308144 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.308104 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbnk4\"" Jun 09 00:19:50.308144 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.308114 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.309015 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.308995 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.309101 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.309055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.309287 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.309269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.309360 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.309297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j968d\"" Jun 09 00:19:50.310104 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.310090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-462nj\"" Jun 09 00:19:50.310512 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.310466 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.310610 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.310533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.310794 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.310777 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 00:19:50.311087 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.310538 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.311087 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.310988 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 00:19:50.311087 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.311041 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 00:19:50.311489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.311473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wkbr9\"" Jun 09 00:19:50.311991 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.311972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.312072 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.312044 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:19:50.312158 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.312143 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 00:19:50.312577 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.312542 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 00:19:50.312766 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.312751 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 00:19:50.312833 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.312758 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qsp7w\"" Jun 09 00:19:50.314186 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.313794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.316161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.315947 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mxg7h\"" Jun 09 00:19:50.316612 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.316322 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.316612 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.316371 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 00:19:50.316612 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.316411 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.316948 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.316930 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 00:19:50.317697 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.317681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.317957 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.317937 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 00:19:50.318185 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.318167 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 00:19:50.318267 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.318171 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 00:19:50.318837 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.318819 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.319329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.319132 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ghcwt\"" Jun 09 00:19:50.319329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.319178 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.319329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.319135 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.319329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.319260 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:50.319329 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.319310 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:19:50.319643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.319626 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 00:19:50.320826 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.320794 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 00:19:50.320918 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.320800 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nggt2\"" Jun 09 00:19:50.321055 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.320965 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 00:19:50.325690 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-k8s-cni-cncf-io\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.325774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325699 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqkhs\" (UniqueName: \"kubernetes.io/projected/020faf34-5d48-42ae-bc2d-3a77d16cfc19-kube-api-access-nqkhs\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.325774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-os-release\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.325872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-etc-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.325872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysctl-d\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.325872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22cbcf86-045d-44a1-83eb-8e72075b34ec-serviceca\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.325996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-var-lib-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.325996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-device-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.325996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-sys-fs\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.325996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.325952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-cni-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.326141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe-konnectivity-ca\") pod \"konnectivity-agent-dxfsd\" (UID: \"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe\") " pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.326141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.326141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-cnibin\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.326141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326076 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-ovn\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.326141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-multus-certs\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.326141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6tp\" (UniqueName: \"kubernetes.io/projected/8f356eeb-335f-4b25-82ac-25b7877fd130-kube-api-access-5t6tp\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-log-socket\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovnkube-config\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-sys\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c97hl\" (UniqueName: \"kubernetes.io/projected/f724759c-546c-4da0-ad27-413a12ea9bac-kube-api-access-c97hl\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-env-overrides\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-var-lib-kubelet\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5785e48d-6f33-4939-9ff2-0933c2fa18ec-host-slash\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-systemd-units\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-modprobe-d\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-lib-modules\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326440 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-host\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f724759c-546c-4da0-ad27-413a12ea9bac-etc-tuned\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f724759c-546c-4da0-ad27-413a12ea9bac-tmp\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-hostroot\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.326626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-cni-bin\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovnkube-script-lib\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326663 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysconfig\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326684 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmh8\" (UniqueName: \"kubernetes.io/projected/5785e48d-6f33-4939-9ff2-0933c2fa18ec-kube-api-access-tkmh8\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-os-release\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-cni-multus\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-kubelet\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-daemon-config\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5785e48d-6f33-4939-9ff2-0933c2fa18ec-iptables-alerter-script\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-system-cni-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe-agent-certs\") pod \"konnectivity-agent-dxfsd\" (UID: \"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe\") " pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbqjx\" (UniqueName: \"kubernetes.io/projected/22cbcf86-045d-44a1-83eb-8e72075b34ec-kube-api-access-vbqjx\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-kubelet\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.326982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1060865b-3bc3-47ce-973c-d45197e42d2b-kubelet-config\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgcr\" (UniqueName: \"kubernetes.io/projected/9885d60f-1288-4a8c-a778-84ac139ae7ea-kube-api-access-5pgcr\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-systemd\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22cbcf86-045d-44a1-83eb-8e72075b34ec-host\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-netns\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-run-netns\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327145 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-systemd\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovn-node-metrics-cert\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-registration-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-kubernetes\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-socket-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327350 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbll\" (UniqueName: \"kubernetes.io/projected/b8681e4f-fd46-4459-a758-86bd8e59af0b-kube-api-access-zkbll\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.327624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-hosts-file\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-tmp-dir\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-cni-bin\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1060865b-3bc3-47ce-973c-d45197e42d2b-dbus\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-cnibin\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-socket-dir-parent\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327657 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-conf-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-system-cni-dir\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysctl-conf\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-run\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp46j\" (UniqueName: \"kubernetes.io/projected/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-kube-api-access-bp46j\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327818 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/020faf34-5d48-42ae-bc2d-3a77d16cfc19-cni-binary-copy\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-etc-kubernetes\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327852 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.328335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-slash\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.328956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-node-log\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.328956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.327968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-cni-netd\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.328956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.328023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.328956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.328047 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjkx9\" (UniqueName: \"kubernetes.io/projected/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-kube-api-access-zjkx9\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.353059 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.353033 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mmnhk" Jun 09 00:19:50.358700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.358604 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mmnhk" Jun 09 00:19:50.381888 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.381784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" event={"ID":"fc2317c6ca6ce2c8715a52a78254c178","Type":"ContainerStarted","Data":"4cd94cc91a7c54974d35f92ac6485432733aa95ec29f9b647c0e46ac67c90293"} Jun 09 00:19:50.383218 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.383180 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" event={"ID":"d2a1b68d42b5a5bdd530bb75ef5c66ef","Type":"ContainerStarted","Data":"0970dd5c086e007532f2e9602bb0f19c76c9e0ea80b8b5ceeef02593407b5d20"} Jun 09 00:19:50.417802 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.417782 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 00:19:50.428735 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.428838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-cnibin\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.428838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-socket-dir-parent\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.428838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-conf-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.428838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.428838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-system-cni-dir\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428865 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-socket-dir-parent\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-system-cni-dir\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428909 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-cnibin\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428866 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysctl-conf\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-run\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.428976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp46j\" (UniqueName: \"kubernetes.io/projected/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-kube-api-access-bp46j\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/020faf34-5d48-42ae-bc2d-3a77d16cfc19-cni-binary-copy\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429015 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysctl-conf\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-etc-kubernetes\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429045 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-slash\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429070 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-run\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-node-log\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429104 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-cni-netd\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-conf-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkx9\" (UniqueName: \"kubernetes.io/projected/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-kube-api-access-zjkx9\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-k8s-cni-cncf-io\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqkhs\" (UniqueName: \"kubernetes.io/projected/020faf34-5d48-42ae-bc2d-3a77d16cfc19-kube-api-access-nqkhs\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-os-release\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-etc-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysctl-d\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.429653 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22cbcf86-045d-44a1-83eb-8e72075b34ec-serviceca\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429668 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-var-lib-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-slash\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-device-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429711 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/020faf34-5d48-42ae-bc2d-3a77d16cfc19-cni-binary-copy\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-sys-fs\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429739 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-device-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-cni-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe-konnectivity-ca\") pod \"konnectivity-agent-dxfsd\" (UID: \"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe\") " pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429798 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-etc-kubernetes\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-node-log\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-cnibin\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429866 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-cni-netd\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429882 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-sys-fs\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-ovn\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429898 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-cnibin\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.430178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-multus-certs\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6tp\" (UniqueName: \"kubernetes.io/projected/8f356eeb-335f-4b25-82ac-25b7877fd130-kube-api-access-5t6tp\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.430462 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-log-socket\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.430569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovnkube-config\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.430613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-sys\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.430640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c97hl\" (UniqueName: \"kubernetes.io/projected/f724759c-546c-4da0-ad27-413a12ea9bac-kube-api-access-c97hl\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.430814 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.430828 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-etc-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.430927 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.430926 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:50.930876101 +0000 UTC m=+2.978603530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431026 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysctl-d\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-env-overrides\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431199 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-ovn\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-var-lib-kubelet\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5785e48d-6f33-4939-9ff2-0933c2fa18ec-host-slash\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431252 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe-konnectivity-ca\") pod \"konnectivity-agent-dxfsd\" (UID: \"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe\") " pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.431317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431256 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-var-lib-kubelet\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-systemd-units\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-modprobe-d\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431369 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-var-lib-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-lib-modules\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431417 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-systemd-units\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431476 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-lib-modules\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-host\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431495 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5785e48d-6f33-4939-9ff2-0933c2fa18ec-host-slash\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-k8s-cni-cncf-io\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22cbcf86-045d-44a1-83eb-8e72075b34ec-serviceca\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-modprobe-d\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.431663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-host\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431677 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f724759c-546c-4da0-ad27-413a12ea9bac-etc-tuned\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f724759c-546c-4da0-ad27-413a12ea9bac-tmp\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-hostroot\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-cni-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431751 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-multus-certs\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431866 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-hostroot\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-cni-bin\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.429946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-os-release\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.431972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovnkube-script-lib\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysconfig\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmh8\" (UniqueName: \"kubernetes.io/projected/5785e48d-6f33-4939-9ff2-0933c2fa18ec-kube-api-access-tkmh8\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432105 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-os-release\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f356eeb-335f-4b25-82ac-25b7877fd130-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-cni-multus\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432185 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-cni-bin\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-kubelet\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.432222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-sysconfig\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-kubelet\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432294 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-os-release\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432126 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432330 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-cni-multus\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432395 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-log-socket\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovnkube-config\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-sys\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-daemon-config\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5785e48d-6f33-4939-9ff2-0933c2fa18ec-iptables-alerter-script\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-system-cni-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432955 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-env-overrides\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.432961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe-agent-certs\") pod \"konnectivity-agent-dxfsd\" (UID: \"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe\") " pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbqjx\" (UniqueName: \"kubernetes.io/projected/22cbcf86-045d-44a1-83eb-8e72075b34ec-kube-api-access-vbqjx\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.433073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-kubelet\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1060865b-3bc3-47ce-973c-d45197e42d2b-kubelet-config\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgcr\" (UniqueName: \"kubernetes.io/projected/9885d60f-1288-4a8c-a778-84ac139ae7ea-kube-api-access-5pgcr\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-systemd\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22cbcf86-045d-44a1-83eb-8e72075b34ec-host\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433412 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovnkube-script-lib\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-netns\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433494 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-run-netns\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1060865b-3bc3-47ce-973c-d45197e42d2b-kubelet-config\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-openvswitch\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.433760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-kubelet\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-run-netns\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-systemd\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433847 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovn-node-metrics-cert\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22cbcf86-045d-44a1-83eb-8e72075b34ec-host\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-registration-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433931 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-system-cni-dir\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-kubernetes\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-socket-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.433996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbll\" (UniqueName: \"kubernetes.io/projected/b8681e4f-fd46-4459-a758-86bd8e59af0b-kube-api-access-zkbll\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-hosts-file\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-tmp-dir\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-cni-bin\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434194 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5785e48d-6f33-4939-9ff2-0933c2fa18ec-iptables-alerter-script\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.434310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1060865b-3bc3-47ce-973c-d45197e42d2b-dbus\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434273 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1060865b-3bc3-47ce-973c-d45197e42d2b-dbus\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434329 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-host-run-netns\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-socket-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434596 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-systemd\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9885d60f-1288-4a8c-a778-84ac139ae7ea-run-systemd\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.435123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.434932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.435473 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.435473 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435451 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/020faf34-5d48-42ae-bc2d-3a77d16cfc19-host-var-lib-cni-bin\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.435660 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-tmp-dir\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.435794 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435764 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f724759c-546c-4da0-ad27-413a12ea9bac-etc-kubernetes\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.435881 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-registration-dir\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.435969 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435864 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f356eeb-335f-4b25-82ac-25b7877fd130-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.435969 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.435901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-hosts-file\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.436545 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.436508 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:50.436671 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.436594 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:50.936578051 +0000 UTC m=+2.984305482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:50.436911 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.436890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/020faf34-5d48-42ae-bc2d-3a77d16cfc19-multus-daemon-config\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.439791 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.439639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f724759c-546c-4da0-ad27-413a12ea9bac-tmp\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.440493 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.440057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe-agent-certs\") pod \"konnectivity-agent-dxfsd\" (UID: \"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe\") " pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.441211 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.440968 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f724759c-546c-4da0-ad27-413a12ea9bac-etc-tuned\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.442367 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.442346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp46j\" (UniqueName: \"kubernetes.io/projected/f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e-kube-api-access-bp46j\") pod \"node-resolver-7nxx4\" (UID: \"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e\") " pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.443145 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.443103 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9885d60f-1288-4a8c-a778-84ac139ae7ea-ovn-node-metrics-cert\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.447656 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.447634 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c97hl\" (UniqueName: \"kubernetes.io/projected/f724759c-546c-4da0-ad27-413a12ea9bac-kube-api-access-c97hl\") pod \"tuned-6qqz9\" (UID: \"f724759c-546c-4da0-ad27-413a12ea9bac\") " pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.447936 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.447912 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmh8\" (UniqueName: \"kubernetes.io/projected/5785e48d-6f33-4939-9ff2-0933c2fa18ec-kube-api-access-tkmh8\") pod \"iptables-alerter-6wskc\" (UID: \"5785e48d-6f33-4939-9ff2-0933c2fa18ec\") " pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.448030 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.448009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6tp\" (UniqueName: \"kubernetes.io/projected/8f356eeb-335f-4b25-82ac-25b7877fd130-kube-api-access-5t6tp\") pod \"multus-additional-cni-plugins-r6mhg\" (UID: \"8f356eeb-335f-4b25-82ac-25b7877fd130\") " pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.448305 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.448285 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgcr\" (UniqueName: \"kubernetes.io/projected/9885d60f-1288-4a8c-a778-84ac139ae7ea-kube-api-access-5pgcr\") pod \"ovnkube-node-qm6wc\" (UID: \"9885d60f-1288-4a8c-a778-84ac139ae7ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.448431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.448416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbqjx\" (UniqueName: \"kubernetes.io/projected/22cbcf86-045d-44a1-83eb-8e72075b34ec-kube-api-access-vbqjx\") pod \"node-ca-65qx9\" (UID: \"22cbcf86-045d-44a1-83eb-8e72075b34ec\") " pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.448774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.448713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqkhs\" (UniqueName: \"kubernetes.io/projected/020faf34-5d48-42ae-bc2d-3a77d16cfc19-kube-api-access-nqkhs\") pod \"multus-rh9f6\" (UID: \"020faf34-5d48-42ae-bc2d-3a77d16cfc19\") " pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.450477 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.450442 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbll\" (UniqueName: \"kubernetes.io/projected/b8681e4f-fd46-4459-a758-86bd8e59af0b-kube-api-access-zkbll\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.452788 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.452763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkx9\" (UniqueName: \"kubernetes.io/projected/84f5f12c-93a6-44bf-9e24-06fe5799a5bd-kube-api-access-zjkx9\") pod \"aws-ebs-csi-driver-node-4smdk\" (UID: \"84f5f12c-93a6-44bf-9e24-06fe5799a5bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.534995 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.534971 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:50.540354 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.540200 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:50.540354 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.540223 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:50.540354 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.540237 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:50.540354 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.540290 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:51.040274353 +0000 UTC m=+3.088001770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:50.620826 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.620774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6wskc" Jun 09 00:19:50.625998 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.625980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" Jun 09 00:19:50.628358 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.627896 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5785e48d_6f33_4939_9ff2_0933c2fa18ec.slice/crio-8572c289a58ff7e92ff76f3037fa408b52650b8e88974c7e2bfdbc158bc916d1 WatchSource:0}: Error finding container 8572c289a58ff7e92ff76f3037fa408b52650b8e88974c7e2bfdbc158bc916d1: Status 404 returned error can't find the container with id 8572c289a58ff7e92ff76f3037fa408b52650b8e88974c7e2bfdbc158bc916d1 Jun 09 00:19:50.634228 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.634206 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7nxx4" Jun 09 00:19:50.637668 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.637585 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f5f12c_93a6_44bf_9e24_06fe5799a5bd.slice/crio-9d53656120673ebe55877d6d21c496c6c1b9148fed9f13aec72c1473881ee70a WatchSource:0}: Error finding container 9d53656120673ebe55877d6d21c496c6c1b9148fed9f13aec72c1473881ee70a: Status 404 returned error can't find the container with id 9d53656120673ebe55877d6d21c496c6c1b9148fed9f13aec72c1473881ee70a Jun 09 00:19:50.638857 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.638671 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" Jun 09 00:19:50.645450 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.645427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rh9f6" Jun 09 00:19:50.646211 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.646191 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48eec7d_aad5_4e92_8ecf_8b8f7b9b9f2e.slice/crio-d0602f10b64ccab8fffc0443678856f0678e149620b8ff964f8d8d7936fc56ca WatchSource:0}: Error finding container d0602f10b64ccab8fffc0443678856f0678e149620b8ff964f8d8d7936fc56ca: Status 404 returned error can't find the container with id d0602f10b64ccab8fffc0443678856f0678e149620b8ff964f8d8d7936fc56ca Jun 09 00:19:50.649723 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.649514 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f356eeb_335f_4b25_82ac_25b7877fd130.slice/crio-0e79098c9618d75f996220010c018bccd057c0257014e58ce65b8ab8f1c0fa45 WatchSource:0}: Error finding container 0e79098c9618d75f996220010c018bccd057c0257014e58ce65b8ab8f1c0fa45: Status 404 returned error can't find the container with id 0e79098c9618d75f996220010c018bccd057c0257014e58ce65b8ab8f1c0fa45 Jun 09 00:19:50.652434 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.652410 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:19:50.654526 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.654471 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020faf34_5d48_42ae_bc2d_3a77d16cfc19.slice/crio-6e01d92ebf6994ecbce83ae7c4bfad6bf6ae24a3301d2e0b0ed8b6f2155fc288 WatchSource:0}: Error finding container 6e01d92ebf6994ecbce83ae7c4bfad6bf6ae24a3301d2e0b0ed8b6f2155fc288: Status 404 returned error can't find the container with id 6e01d92ebf6994ecbce83ae7c4bfad6bf6ae24a3301d2e0b0ed8b6f2155fc288 Jun 09 00:19:50.660763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.660745 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:19:50.660939 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.660910 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48912ee2_aaaf_40bf_aa6e_c1cc1308f0fe.slice/crio-2dd8f912135171db25cedb2f5d76a95ccd56ec7380510fbbecbf28c6db69e715 WatchSource:0}: Error finding container 2dd8f912135171db25cedb2f5d76a95ccd56ec7380510fbbecbf28c6db69e715: Status 404 returned error can't find the container with id 2dd8f912135171db25cedb2f5d76a95ccd56ec7380510fbbecbf28c6db69e715 Jun 09 00:19:50.668349 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.668324 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" Jun 09 00:19:50.668595 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:50.668575 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9885d60f_1288_4a8c_a778_84ac139ae7ea.slice/crio-7a46becefeaf93cfa5d3927141abbe15f1bb792ed8af4a6bbb1abb1c902129fb WatchSource:0}: Error finding container 7a46becefeaf93cfa5d3927141abbe15f1bb792ed8af4a6bbb1abb1c902129fb: Status 404 returned error can't find the container with id 7a46becefeaf93cfa5d3927141abbe15f1bb792ed8af4a6bbb1abb1c902129fb Jun 09 00:19:50.673958 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.673934 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-65qx9" Jun 09 00:19:50.937737 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.937526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:50.937846 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:50.937761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:50.937846 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.937687 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:50.937990 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.937870 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:50.937990 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.937873 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:51.937854633 +0000 UTC m=+3.985582065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:50.937990 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:50.937924 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:51.937907946 +0000 UTC m=+3.985635380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:51.139171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.139134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:51.139320 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.139269 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:51.139320 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.139287 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:51.139320 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.139297 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:51.139474 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.139342 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:52.139329412 +0000 UTC m=+4.187056842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:51.360663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.360580 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 00:14:50 +0000 UTC" deadline="2028-01-11 10:34:33.72654458 +0000 UTC" Jun 09 00:19:51.360663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.360615 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13954h14m42.365934601s" Jun 09 00:19:51.387259 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.387219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7nxx4" event={"ID":"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e","Type":"ContainerStarted","Data":"d0602f10b64ccab8fffc0443678856f0678e149620b8ff964f8d8d7936fc56ca"} Jun 09 00:19:51.388590 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:19:51.388389 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cbcf86_045d_44a1_83eb_8e72075b34ec.slice/crio-7e56734b3b2b7562f43b9aca2686e3967e1c9b3448656e3008f3985da1c284ce WatchSource:0}: Error finding container 7e56734b3b2b7562f43b9aca2686e3967e1c9b3448656e3008f3985da1c284ce: Status 404 returned error can't find the container with id 7e56734b3b2b7562f43b9aca2686e3967e1c9b3448656e3008f3985da1c284ce Jun 09 00:19:51.388590 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.388507 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" event={"ID":"84f5f12c-93a6-44bf-9e24-06fe5799a5bd","Type":"ContainerStarted","Data":"9d53656120673ebe55877d6d21c496c6c1b9148fed9f13aec72c1473881ee70a"} Jun 09 00:19:51.389876 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.389829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6wskc" event={"ID":"5785e48d-6f33-4939-9ff2-0933c2fa18ec","Type":"ContainerStarted","Data":"8572c289a58ff7e92ff76f3037fa408b52650b8e88974c7e2bfdbc158bc916d1"} Jun 09 00:19:51.391407 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.391376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"7a46becefeaf93cfa5d3927141abbe15f1bb792ed8af4a6bbb1abb1c902129fb"} Jun 09 00:19:51.392864 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.392810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxfsd" event={"ID":"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe","Type":"ContainerStarted","Data":"2dd8f912135171db25cedb2f5d76a95ccd56ec7380510fbbecbf28c6db69e715"} Jun 09 00:19:51.395420 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.395396 2572 generic.go:356] "Generic (PLEG): container finished" podID="d2a1b68d42b5a5bdd530bb75ef5c66ef" containerID="42252736062a909c61357ef2b830d1222bebee8b19ba57ef68268d44fc9a44f2" exitCode=0 Jun 09 00:19:51.395498 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.395430 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" event={"ID":"d2a1b68d42b5a5bdd530bb75ef5c66ef","Type":"ContainerDied","Data":"42252736062a909c61357ef2b830d1222bebee8b19ba57ef68268d44fc9a44f2"} Jun 09 00:19:51.397053 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.396999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" event={"ID":"f724759c-546c-4da0-ad27-413a12ea9bac","Type":"ContainerStarted","Data":"1f544a69736250123abd75d5dbe1cbe23ecc7ec55aeb209c62e88e94308458a9"} Jun 09 00:19:51.399044 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.399021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rh9f6" event={"ID":"020faf34-5d48-42ae-bc2d-3a77d16cfc19","Type":"ContainerStarted","Data":"6e01d92ebf6994ecbce83ae7c4bfad6bf6ae24a3301d2e0b0ed8b6f2155fc288"} Jun 09 00:19:51.400355 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.400336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerStarted","Data":"0e79098c9618d75f996220010c018bccd057c0257014e58ce65b8ab8f1c0fa45"} Jun 09 00:19:51.944756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.944719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:51.944922 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:51.944775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:51.944922 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.944903 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:51.945022 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.944963 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:53.944943394 +0000 UTC m=+5.992670814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:51.945022 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.944904 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:51.945143 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:51.945034 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:53.945015926 +0000 UTC m=+5.992743345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:52.146416 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.146384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:52.146639 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.146581 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:52.146639 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.146601 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:52.146639 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.146612 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:52.146807 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.146662 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:54.146646503 +0000 UTC m=+6.194373919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:52.361233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.361127 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 00:14:50 +0000 UTC" deadline="2027-12-28 14:33:00.978441366 +0000 UTC" Jun 09 00:19:52.361233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.361181 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13622h13m8.617264594s" Jun 09 00:19:52.378231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.377529 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:52.378231 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.377658 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:19:52.378231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.377532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:52.378231 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.378068 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:19:52.378231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.378128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:52.378231 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:52.378193 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:19:52.419015 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.418989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" event={"ID":"fc2317c6ca6ce2c8715a52a78254c178","Type":"ContainerStarted","Data":"7b5d4eaa730cc9227ec012ed5eeb5cdd5fa4c30c04513d09933333e74e4c36e8"} Jun 09 00:19:52.425632 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.425609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-65qx9" event={"ID":"22cbcf86-045d-44a1-83eb-8e72075b34ec","Type":"ContainerStarted","Data":"7e56734b3b2b7562f43b9aca2686e3967e1c9b3448656e3008f3985da1c284ce"} Jun 09 00:19:52.440140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.439663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" event={"ID":"d2a1b68d42b5a5bdd530bb75ef5c66ef","Type":"ContainerStarted","Data":"f88488fec6efb6978554c4c224271531ccd1f52990e2a423486016e51adfe462"} Jun 09 00:19:52.454634 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:52.453590 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-224.ec2.internal" podStartSLOduration=3.453544849 podStartE2EDuration="3.453544849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:19:52.432916183 +0000 UTC m=+4.480643620" watchObservedRunningTime="2026-06-09 00:19:52.453544849 +0000 UTC m=+4.501272285" Jun 09 00:19:53.957872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:53.957835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:53.958304 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:53.957886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:53.958304 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:53.958031 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:53.958304 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:53.958084 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:57.958066868 +0000 UTC m=+10.005794289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:53.958464 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:53.958356 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:53.958464 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:53.958405 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:19:57.958390283 +0000 UTC m=+10.006117702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:54.159803 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:54.159770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:54.159969 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.159953 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:54.160030 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.159976 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:54.160030 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.159988 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:54.160120 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.160043 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:19:58.160026693 +0000 UTC m=+10.207754114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:54.378435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:54.378201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:54.378435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:54.378199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:54.378435 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.378317 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:19:54.378435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:54.378333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:54.378435 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.378431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:19:54.378805 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:54.378545 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:19:56.377727 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:56.377684 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:56.378154 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:56.377782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:56.378154 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:56.377804 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:19:56.378154 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:56.377894 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:19:56.378154 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:56.377689 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:56.378154 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:56.377992 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:19:57.986216 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:57.986175 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:57.986646 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:57.986232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:57.986646 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:57.986341 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:57.986646 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:57.986343 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:57.986646 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:57.986397 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:05.986378247 +0000 UTC m=+18.034105665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:19:57.986646 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:57.986415 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:05.986405846 +0000 UTC m=+18.034133261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:19:58.187647 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:58.187495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:58.187800 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.187662 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:19:58.187800 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.187683 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:19:58.187800 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.187692 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:58.187800 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.187737 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:06.18772406 +0000 UTC m=+18.235451475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:19:58.378221 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:58.378146 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:19:58.378374 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:58.378248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:19:58.378374 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.378257 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:19:58.378374 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:19:58.378281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:19:58.378374 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.378348 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:19:58.378609 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:19:58.378462 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:00.377949 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:00.377858 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:00.377949 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:00.377900 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:00.377949 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:00.377867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:00.378430 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:00.377995 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:00.378430 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:00.378083 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:00.378430 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:00.378196 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:02.377961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:02.377859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:02.377961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:02.377859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:02.378436 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:02.377977 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:02.378436 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:02.377990 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:02.378436 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:02.378061 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:02.378436 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:02.378127 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:04.378176 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.377972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:04.378647 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.377972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:04.378647 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:04.378220 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:04.378647 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.378035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:04.378647 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:04.378324 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:04.378647 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:04.378408 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:04.460974 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.460944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" event={"ID":"84f5f12c-93a6-44bf-9e24-06fe5799a5bd","Type":"ContainerStarted","Data":"1122ecbb85b5de15d8b106c87de16d84fe2bb69b6e740a2c2d75186d86e53081"} Jun 09 00:20:04.462568 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.462530 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxfsd" event={"ID":"48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe","Type":"ContainerStarted","Data":"f6516f22dfbab1c41d50bc6fb432ab7e94bc2c6672d733cb8550e665a6788278"} Jun 09 00:20:04.464046 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.464000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-65qx9" event={"ID":"22cbcf86-045d-44a1-83eb-8e72075b34ec","Type":"ContainerStarted","Data":"3d07b5557e63f3ad5393ed24699a3678f138358acfde15fe51deb03b418bc786"} Jun 09 00:20:04.466064 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.465729 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" event={"ID":"f724759c-546c-4da0-ad27-413a12ea9bac","Type":"ContainerStarted","Data":"12b610b23c74c9dca5bf97e648c3f0670a4ebaff2ec313b3377048b4100f3e24"} Jun 09 00:20:04.467520 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.467459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rh9f6" event={"ID":"020faf34-5d48-42ae-bc2d-3a77d16cfc19","Type":"ContainerStarted","Data":"398c288589874865e8c75c59238688d3e3b768d4337a4429ac9220d7404bc3ef"} Jun 09 00:20:04.469140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.469117 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f356eeb-335f-4b25-82ac-25b7877fd130" containerID="cac8e9efa49bd3b0b10ff45b1e192af5154acea2e16be64da761ddcc73c365af" exitCode=0 Jun 09 00:20:04.469230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.469207 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerDied","Data":"cac8e9efa49bd3b0b10ff45b1e192af5154acea2e16be64da761ddcc73c365af"} Jun 09 00:20:04.470659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.470610 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7nxx4" event={"ID":"f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e","Type":"ContainerStarted","Data":"83f2ea068642f78ef2299c84e9136f03d0cf95fc6ed55f22519318717dc84b7d"} Jun 09 00:20:04.476913 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.476870 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dxfsd" podStartSLOduration=3.541966173 podStartE2EDuration="16.476854729s" totalImagesPullingTime="12.934888556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:04.476698563 +0000 UTC m=+16.524425998" watchObservedRunningTime="2026-06-09 00:20:04.476854729 +0000 UTC m=+16.524582168" Jun 09 00:20:04.477115 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.477087 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-224.ec2.internal" podStartSLOduration=15.477080725 podStartE2EDuration="15.477080725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:19:52.454615447 +0000 UTC m=+4.502342883" watchObservedRunningTime="2026-06-09 00:20:04.477080725 +0000 UTC m=+16.524808163" Jun 09 00:20:04.490435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.490400 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7nxx4" podStartSLOduration=3.541398234 podStartE2EDuration="16.490385878s" totalImagesPullingTime="12.948987644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:04.490137374 +0000 UTC m=+16.537864813" watchObservedRunningTime="2026-06-09 00:20:04.490385878 +0000 UTC m=+16.538113316" Jun 09 00:20:04.506254 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.506215 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rh9f6" podStartSLOduration=3.458481452 podStartE2EDuration="16.506202401s" totalImagesPullingTime="13.047720949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:04.505739008 +0000 UTC m=+16.553466444" watchObservedRunningTime="2026-06-09 00:20:04.506202401 +0000 UTC m=+16.553929835" Jun 09 00:20:04.555059 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.555012 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6qqz9" podStartSLOduration=3.943494827 podStartE2EDuration="16.554996413s" totalImagesPullingTime="12.611501586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:04.541302587 +0000 UTC m=+16.589030023" watchObservedRunningTime="2026-06-09 00:20:04.554996413 +0000 UTC m=+16.602723850" Jun 09 00:20:04.555161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.555138 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-65qx9" podStartSLOduration=4.347942807 podStartE2EDuration="16.555131605s" totalImagesPullingTime="12.207188798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:04.554772006 +0000 UTC m=+16.602499442" watchObservedRunningTime="2026-06-09 00:20:04.555131605 +0000 UTC m=+16.602859041" Jun 09 00:20:04.739193 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:04.739170 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 00:20:05.378712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:05.378603 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T00:20:04.7391884Z","UUID":"3a922c82-9286-4477-83e0-4dbf5ba99ce5","Handler":null,"Name":"","Endpoint":""} Jun 09 00:20:05.380522 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:05.380491 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 00:20:05.380659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:05.380533 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 00:20:05.475327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:05.475284 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" event={"ID":"84f5f12c-93a6-44bf-9e24-06fe5799a5bd","Type":"ContainerStarted","Data":"b0d8517fb08c168fb9f0f4fe28a411e921eb6380e2476401fea07a3e6a38f272"} Jun 09 00:20:05.477152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:05.477120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6wskc" event={"ID":"5785e48d-6f33-4939-9ff2-0933c2fa18ec","Type":"ContainerStarted","Data":"449b887cbde52244cd41631cdd43683b7e983dc5ba239ba2232f16907897ed89"} Jun 09 00:20:05.492671 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:05.492633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6wskc" podStartSLOduration=4.525768418 podStartE2EDuration="17.492621883s" totalImagesPullingTime="12.966853465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:05.492267634 +0000 UTC m=+17.539995069" watchObservedRunningTime="2026-06-09 00:20:05.492621883 +0000 UTC m=+17.540349319" Jun 09 00:20:06.045441 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.045372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:06.045441 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.045413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:06.045672 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.045515 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:06.045672 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.045515 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:06.045672 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.045590 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:22.045550099 +0000 UTC m=+34.093277530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:06.045672 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.045607 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:22.045596734 +0000 UTC m=+34.093324154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:06.247010 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.246970 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:06.247158 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.247117 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:20:06.247158 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.247137 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:20:06.247158 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.247149 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:06.247288 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.247199 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:22.24718477 +0000 UTC m=+34.294912185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:06.378063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.377787 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:06.378063 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.377898 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:06.378063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.377927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:06.378063 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.378027 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:06.378063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.377799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:06.378367 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:06.378113 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:06.481905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.481875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" event={"ID":"84f5f12c-93a6-44bf-9e24-06fe5799a5bd","Type":"ContainerStarted","Data":"4a108873cde32d2328ef36a33efacf9b536db0200f12a819b3f84384ca72f857"} Jun 09 00:20:06.500091 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:06.499988 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4smdk" podStartSLOduration=3.720248784 podStartE2EDuration="18.499969817s" totalImagesPullingTime="14.779721033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:06.499279611 +0000 UTC m=+18.547007048" watchObservedRunningTime="2026-06-09 00:20:06.499969817 +0000 UTC m=+18.547697255" Jun 09 00:20:08.082415 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.082184 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:20:08.082898 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.082739 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:20:08.378849 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.378736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:08.378849 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:08.378832 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:08.379051 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.378875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:08.379051 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.378889 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:08.379051 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:08.378986 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:08.379174 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:08.379050 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:08.485887 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.485857 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:20:08.486290 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:08.486275 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dxfsd" Jun 09 00:20:10.378107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:10.378081 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:10.378107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:10.378093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:10.378599 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:10.378201 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:10.378599 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:10.378289 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:10.378599 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:10.378342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:10.378599 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:10.378443 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:12.378166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:12.378134 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:12.378704 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:12.378138 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:12.378704 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:12.378244 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:12.378704 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:12.378275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:12.378704 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:12.378349 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:12.378704 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:12.378437 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:13.497820 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.497632 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f356eeb-335f-4b25-82ac-25b7877fd130" containerID="71434974f9cbccf7d87f042c4d7fdfdaf0d9d36ace49a5dba6b98f1d9feb4a03" exitCode=0 Jun 09 00:20:13.498448 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.497724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerDied","Data":"71434974f9cbccf7d87f042c4d7fdfdaf0d9d36ace49a5dba6b98f1d9feb4a03"} Jun 09 00:20:13.501233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501211 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:20:13.501623 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501595 2572 generic.go:356] "Generic (PLEG): container finished" podID="9885d60f-1288-4a8c-a778-84ac139ae7ea" containerID="2ac8fc6a229df72fa808824031de477e3b8cbcdb55ae590e720a282310f000fc" exitCode=1 Jun 09 00:20:13.501721 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"32e14e426bb5c3bbe2b77ee5691a2b54bfff9d42911d85d14db6458c6a1f0177"} Jun 09 00:20:13.501721 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501700 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"ed9c580d3d4d0337c5e679a7c43a818c41ea09debfb5e460ddd5f389552c0318"} Jun 09 00:20:13.501809 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"c82abdc551a10c396201f2cc706de13ef63e19bc858176dc0e5abebd6ee89ad3"} Jun 09 00:20:13.501809 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"a0fa9e00d7d4fa69683594ef2beea8b3fbba037963a50c66786708d5abdaebf2"} Jun 09 00:20:13.501809 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerDied","Data":"2ac8fc6a229df72fa808824031de477e3b8cbcdb55ae590e720a282310f000fc"} Jun 09 00:20:13.501967 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:13.501814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"3180f43322f4d0360ff3e3fb30ebe85207115633ea0e6821d6aaaa9d236fb5ad"} Jun 09 00:20:14.377961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:14.377927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:14.377961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:14.377940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:14.378295 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:14.377932 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:14.378295 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:14.378021 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:14.378295 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:14.378108 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:14.378295 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:14.378166 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:15.506797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:15.506737 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f356eeb-335f-4b25-82ac-25b7877fd130" containerID="4db101bc4233d57743189c832c0f34e33f50e680265fc79c9f180e7baf8df9af" exitCode=0 Jun 09 00:20:15.507198 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:15.506823 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerDied","Data":"4db101bc4233d57743189c832c0f34e33f50e680265fc79c9f180e7baf8df9af"} Jun 09 00:20:15.509810 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:15.509794 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:20:15.510157 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:15.510139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"9e4a22e655031196feefe67c12326c604fa1929d66c1f80378fa4017d375cd97"} Jun 09 00:20:16.377386 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:16.377357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:16.377386 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:16.377387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:16.377660 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:16.377359 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:16.377660 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:16.377470 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:16.377660 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:16.377538 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:16.377660 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:16.377630 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:17.517499 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.517376 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:20:17.517945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.517917 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"796e98e59578a59141ccb9d31bcf76aa66a304ae22935182c412650e660b738f"} Jun 09 00:20:17.518249 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.518210 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:20:17.518347 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.518283 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:20:17.518406 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.518397 2572 scope.go:117] "RemoveContainer" containerID="2ac8fc6a229df72fa808824031de477e3b8cbcdb55ae590e720a282310f000fc" Jun 09 00:20:17.520711 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.520686 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f356eeb-335f-4b25-82ac-25b7877fd130" containerID="cb8069144bd054c6e446e289b12ced98aa0e06799f532f33b940727d5075f374" exitCode=0 Jun 09 00:20:17.520812 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.520732 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerDied","Data":"cb8069144bd054c6e446e289b12ced98aa0e06799f532f33b940727d5075f374"} Jun 09 00:20:17.533666 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:17.533641 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:20:18.378211 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.378181 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:18.378422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.378255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:18.378422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.378299 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:18.378422 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:18.378314 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:18.378422 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:18.378383 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:18.378648 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:18.378494 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:18.526020 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.525994 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:20:18.526369 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.526285 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" event={"ID":"9885d60f-1288-4a8c-a778-84ac139ae7ea","Type":"ContainerStarted","Data":"b63edb75de0c6b10bee8cf5342457b3497c2b0bfe1660f968fcc83a714c9e0ca"} Jun 09 00:20:18.526463 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.526449 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:20:18.541041 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.541021 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:20:18.551846 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:18.551812 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" podStartSLOduration=8.640810201 podStartE2EDuration="30.551802839s" totalImagesPullingTime="21.910992638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:18.551646727 +0000 UTC m=+30.599374157" watchObservedRunningTime="2026-06-09 00:20:18.551802839 +0000 UTC m=+30.599530274" Jun 09 00:20:19.319346 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:19.319319 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gn4s"] Jun 09 00:20:19.319470 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:19.319456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:19.319634 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:19.319599 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:19.322394 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:19.322372 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dw7jh"] Jun 09 00:20:19.322498 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:19.322460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:19.322589 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:19.322570 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:19.323028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:19.323009 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ln75"] Jun 09 00:20:19.323116 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:19.323104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:19.323206 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:19.323189 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:21.377844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:21.377688 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:21.377844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:21.377722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:21.377844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:21.377722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:21.377844 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:21.377806 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:21.378435 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:21.377898 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:21.378435 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:21.378002 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:22.068083 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:22.068051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:22.068208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:22.068137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:22.068208 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.068187 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:22.068321 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.068225 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:22.068321 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.068261 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:54.068239884 +0000 UTC m=+66.115967314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 00:20:22.068321 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.068280 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret podName:1060865b-3bc3-47ce-973c-d45197e42d2b nodeName:}" failed. No retries permitted until 2026-06-09 00:20:54.068271184 +0000 UTC m=+66.115998602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret") pod "global-pull-secret-syncer-dw7jh" (UID: "1060865b-3bc3-47ce-973c-d45197e42d2b") : object "kube-system"/"original-pull-secret" not registered Jun 09 00:20:22.269034 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:22.269006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:22.269194 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.269156 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 00:20:22.269194 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.269173 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 00:20:22.269194 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.269181 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vvxsf for pod openshift-network-diagnostics/network-check-target-2ln75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:22.269325 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:22.269232 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf podName:34cb8dba-e0e8-440d-a0ac-437363627152 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:54.269218881 +0000 UTC m=+66.316946312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvxsf" (UniqueName: "kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf") pod "network-check-target-2ln75" (UID: "34cb8dba-e0e8-440d-a0ac-437363627152") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 00:20:23.378121 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:23.378100 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:23.378569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:23.378130 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:23.378569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:23.378130 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:23.378569 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:23.378212 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ln75" podUID="34cb8dba-e0e8-440d-a0ac-437363627152" Jun 09 00:20:23.378569 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:23.378272 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:20:23.378569 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:23.378333 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw7jh" podUID="1060865b-3bc3-47ce-973c-d45197e42d2b" Jun 09 00:20:23.540029 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:23.540003 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f356eeb-335f-4b25-82ac-25b7877fd130" containerID="9f0a95c16c5bded3329a27529873484c572d6cb98b99356b3b1b8347356a4041" exitCode=0 Jun 09 00:20:23.540161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:23.540059 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerDied","Data":"9f0a95c16c5bded3329a27529873484c572d6cb98b99356b3b1b8347356a4041"} Jun 09 00:20:24.243895 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:24.243862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:24.324062 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:24.324035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:24.545401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:24.545331 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f356eeb-335f-4b25-82ac-25b7877fd130" containerID="54c07073745eb814b8c2d9da80e45e0c0f913a1a196e39ffa5cdaffe4b360102" exitCode=0 Jun 09 00:20:24.545401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:24.545380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerDied","Data":"54c07073745eb814b8c2d9da80e45e0c0f913a1a196e39ffa5cdaffe4b360102"} Jun 09 00:20:25.265400 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.265374 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-224.ec2.internal" event="NodeReady" Jun 09 00:20:25.265545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.265481 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 00:20:25.311443 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.311416 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-crtmw"] Jun 09 00:20:25.313763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.313745 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mm2kn"] Jun 09 00:20:25.313880 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.313861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.315980 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.315961 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.316261 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.316105 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 00:20:25.316261 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.316105 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hfdgk\"" Jun 09 00:20:25.316480 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.316459 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 00:20:25.318358 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.318338 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 00:20:25.318672 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.318641 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4nj5d\"" Jun 09 00:20:25.318785 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.318690 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 00:20:25.318980 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.318964 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 00:20:25.323951 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.323930 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mm2kn"] Jun 09 00:20:25.328184 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.328162 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crtmw"] Jun 09 00:20:25.377383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.377337 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:25.377472 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.377338 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:25.377530 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.377341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:25.379840 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.379824 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:20:25.379933 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.379854 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:20:25.379933 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.379916 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:20:25.380044 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.379933 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f26v2\"" Jun 09 00:20:25.380044 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.379937 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ldwg\"" Jun 09 00:20:25.380044 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.380031 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:20:25.390386 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.390368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.390484 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.390395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pslql\" (UniqueName: \"kubernetes.io/projected/3f27364c-dd01-416e-832f-0f135f67c686-kube-api-access-pslql\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.390484 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.390435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvth\" (UniqueName: \"kubernetes.io/projected/fe5c5b78-815b-4253-9117-86114688727a-kube-api-access-wjvth\") pod \"ingress-canary-mm2kn\" (UID: \"fe5c5b78-815b-4253-9117-86114688727a\") " pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.390582 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.390490 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f27364c-dd01-416e-832f-0f135f67c686-config-volume\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.390582 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.390515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f27364c-dd01-416e-832f-0f135f67c686-tmp-dir\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.390582 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.390529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe5c5b78-815b-4253-9117-86114688727a-cert\") pod \"ingress-canary-mm2kn\" (UID: \"fe5c5b78-815b-4253-9117-86114688727a\") " pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.491366 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvth\" (UniqueName: \"kubernetes.io/projected/fe5c5b78-815b-4253-9117-86114688727a-kube-api-access-wjvth\") pod \"ingress-canary-mm2kn\" (UID: \"fe5c5b78-815b-4253-9117-86114688727a\") " pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.491447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f27364c-dd01-416e-832f-0f135f67c686-config-volume\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.491447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f27364c-dd01-416e-832f-0f135f67c686-tmp-dir\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.491447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe5c5b78-815b-4253-9117-86114688727a-cert\") pod \"ingress-canary-mm2kn\" (UID: \"fe5c5b78-815b-4253-9117-86114688727a\") " pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.491658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491470 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.491658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pslql\" (UniqueName: \"kubernetes.io/projected/3f27364c-dd01-416e-832f-0f135f67c686-kube-api-access-pslql\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.491658 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:25.491589 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:25.491658 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:25.491654 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:25.991636906 +0000 UTC m=+38.039364322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:25.491850 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491816 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f27364c-dd01-416e-832f-0f135f67c686-tmp-dir\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.491964 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.491946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f27364c-dd01-416e-832f-0f135f67c686-config-volume\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.495245 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.495221 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe5c5b78-815b-4253-9117-86114688727a-cert\") pod \"ingress-canary-mm2kn\" (UID: \"fe5c5b78-815b-4253-9117-86114688727a\") " pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.499868 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.499850 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvth\" (UniqueName: \"kubernetes.io/projected/fe5c5b78-815b-4253-9117-86114688727a-kube-api-access-wjvth\") pod \"ingress-canary-mm2kn\" (UID: \"fe5c5b78-815b-4253-9117-86114688727a\") " pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.500379 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.500365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pslql\" (UniqueName: \"kubernetes.io/projected/3f27364c-dd01-416e-832f-0f135f67c686-kube-api-access-pslql\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.550638 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.550617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" event={"ID":"8f356eeb-335f-4b25-82ac-25b7877fd130","Type":"ContainerStarted","Data":"204b30fbd8b0aa44c73d6b92bda4a447ccd8de88c0d76a44dc1dcb712b929a2f"} Jun 09 00:20:25.570415 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.570377 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r6mhg" podStartSLOduration=8.633237381 podStartE2EDuration="37.570362528s" totalImagesPullingTime="28.937125147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:25.569397659 +0000 UTC m=+37.617125093" watchObservedRunningTime="2026-06-09 00:20:25.570362528 +0000 UTC m=+37.618089964" Jun 09 00:20:25.629403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.629358 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mm2kn" Jun 09 00:20:25.683904 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.683875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:25.751405 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.751259 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mm2kn"] Jun 09 00:20:25.754624 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:20:25.754599 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5c5b78_815b_4253_9117_86114688727a.slice/crio-5a80c45d15a88a6b467d00cb8f4eaa18a7395449be30b37be1be74bf542546e3 WatchSource:0}: Error finding container 5a80c45d15a88a6b467d00cb8f4eaa18a7395449be30b37be1be74bf542546e3: Status 404 returned error can't find the container with id 5a80c45d15a88a6b467d00cb8f4eaa18a7395449be30b37be1be74bf542546e3 Jun 09 00:20:25.755287 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.755266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:25.816095 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.816075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:25.876040 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.876019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:25.994987 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:25.994965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:25.995096 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:25.995057 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:25.995137 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:25.995102 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:26.995088406 +0000 UTC m=+39.042815821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:26.554279 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:26.554247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mm2kn" event={"ID":"fe5c5b78-815b-4253-9117-86114688727a","Type":"ContainerStarted","Data":"5a80c45d15a88a6b467d00cb8f4eaa18a7395449be30b37be1be74bf542546e3"} Jun 09 00:20:26.999333 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:26.999304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:26.999526 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:26.999418 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:26.999526 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:26.999478 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:28.999459978 +0000 UTC m=+41.047187394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:28.031013 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:28.030981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:28.130666 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:28.130631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:28.183221 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:28.183197 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:28.560597 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:28.560567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mm2kn" event={"ID":"fe5c5b78-815b-4253-9117-86114688727a","Type":"ContainerStarted","Data":"c1038817980acf5bcfa3c5e2fa387ada715c3af62421776d1144589bf0cb4db3"} Jun 09 00:20:28.576471 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:28.576429 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mm2kn" podStartSLOduration=1.813505956 podStartE2EDuration="3.576416186s" totalImagesPullingTime="1.76291023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:28.575084499 +0000 UTC m=+40.622811934" watchObservedRunningTime="2026-06-09 00:20:28.576416186 +0000 UTC m=+40.624143673" Jun 09 00:20:29.012641 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:29.012601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:29.012755 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:29.012698 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:29.012755 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:29.012748 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:33.012736215 +0000 UTC m=+45.060463630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:31.741861 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:31.741833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:31.826667 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:31.826640 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:31.914111 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:31.914087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:32.011194 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:32.011132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:33.039181 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:33.039155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:33.039456 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:33.039239 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:33.039456 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:33.039293 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:41.039280587 +0000 UTC m=+53.087008002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:37.728207 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:37.728057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:37.828185 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:37.828158 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:41.094109 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:41.094078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:41.094543 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:41.094224 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:41.094543 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:41.094294 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:20:57.094278566 +0000 UTC m=+69.142005980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:50.539961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:50.539930 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qm6wc" Jun 09 00:20:50.675988 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:50.675958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:50.796189 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:50.796117 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:50.861694 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:50.861672 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:50.909516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:50.909493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:53.881149 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:53.881124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:53.981085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:53.981057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:54.030909 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.030886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:20:54.080921 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.080892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:20:54.081028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.080958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:54.083413 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.083396 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:20:54.083464 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.083403 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:20:54.091145 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:54.091122 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:20:54.091235 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:54.091190 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:21:58.091176405 +0000 UTC m=+130.138903820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : secret "metrics-daemon-secret" not found Jun 09 00:20:54.095043 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.095021 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1060865b-3bc3-47ce-973c-d45197e42d2b-original-pull-secret\") pod \"global-pull-secret-syncer-dw7jh\" (UID: \"1060865b-3bc3-47ce-973c-d45197e42d2b\") " pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:54.195763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.195738 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw7jh" Jun 09 00:20:54.282378 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.282346 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:54.285150 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.285128 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:20:54.295503 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.295482 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:20:54.305401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.305379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvxsf\" (UniqueName: \"kubernetes.io/projected/34cb8dba-e0e8-440d-a0ac-437363627152-kube-api-access-vvxsf\") pod \"network-check-target-2ln75\" (UID: \"34cb8dba-e0e8-440d-a0ac-437363627152\") " pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:54.312624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.312603 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dw7jh"] Jun 09 00:20:54.315321 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:20:54.315300 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1060865b_3bc3_47ce_973c_d45197e42d2b.slice/crio-a1580a50063acf6d86bf410a4c037eff8251bbffad3e12a978c57746bbefa7cb WatchSource:0}: Error finding container a1580a50063acf6d86bf410a4c037eff8251bbffad3e12a978c57746bbefa7cb: Status 404 returned error can't find the container with id a1580a50063acf6d86bf410a4c037eff8251bbffad3e12a978c57746bbefa7cb Jun 09 00:20:54.492951 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.492892 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5ldwg\"" Jun 09 00:20:54.501171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.501149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:54.616476 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.616445 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dw7jh" event={"ID":"1060865b-3bc3-47ce-973c-d45197e42d2b","Type":"ContainerStarted","Data":"a1580a50063acf6d86bf410a4c037eff8251bbffad3e12a978c57746bbefa7cb"} Jun 09 00:20:54.620036 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:54.620012 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ln75"] Jun 09 00:20:54.622832 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:20:54.622805 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cb8dba_e0e8_440d_a0ac_437363627152.slice/crio-72b918ba06c291ba066ff2cbdb9fbec5345652d0675e0e3fcc292a12dce2759d WatchSource:0}: Error finding container 72b918ba06c291ba066ff2cbdb9fbec5345652d0675e0e3fcc292a12dce2759d: Status 404 returned error can't find the container with id 72b918ba06c291ba066ff2cbdb9fbec5345652d0675e0e3fcc292a12dce2759d Jun 09 00:20:55.620591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:55.620536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ln75" event={"ID":"34cb8dba-e0e8-440d-a0ac-437363627152","Type":"ContainerStarted","Data":"72b918ba06c291ba066ff2cbdb9fbec5345652d0675e0e3fcc292a12dce2759d"} Jun 09 00:20:57.107837 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:57.107802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:20:57.108314 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:57.107914 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:20:57.108314 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:20:57.107973 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:21:29.107959851 +0000 UTC m=+101.155687268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:20:58.630110 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:58.630073 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ln75" event={"ID":"34cb8dba-e0e8-440d-a0ac-437363627152","Type":"ContainerStarted","Data":"02d43fc1ec5025311b3ae9109d0d48753bf8cdb517b84097ce82d764c6a20d83"} Jun 09 00:20:58.630512 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:58.630225 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:20:58.645580 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:20:58.645523 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2ln75" podStartSLOduration=67.688223697 podStartE2EDuration="1m10.645507704s" totalImagesPullingTime="2.957284007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:20:58.644625404 +0000 UTC m=+70.692352841" watchObservedRunningTime="2026-06-09 00:20:58.645507704 +0000 UTC m=+70.693235137" Jun 09 00:21:00.636946 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:00.636907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dw7jh" event={"ID":"1060865b-3bc3-47ce-973c-d45197e42d2b","Type":"ContainerStarted","Data":"93ce0cd64fcdf5b75dc08fb2d46115e9b5645660d9f8951193f020a3e4286a2b"} Jun 09 00:21:00.652161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:00.652104 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dw7jh" podStartSLOduration=67.122063015 podStartE2EDuration="1m12.652090329s" totalImagesPullingTime="5.530027314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:21:00.651991403 +0000 UTC m=+72.699718840" watchObservedRunningTime="2026-06-09 00:21:00.652090329 +0000 UTC m=+72.699817764" Jun 09 00:21:04.031526 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:04.031492 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:21:04.132160 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:04.132133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:21:29.207467 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:29.207437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:21:29.207875 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:21:29.207535 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:21:29.207875 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:21:29.207617 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls podName:3f27364c-dd01-416e-832f-0f135f67c686 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:33.207602519 +0000 UTC m=+165.255329934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls") pod "dns-default-crtmw" (UID: "3f27364c-dd01-416e-832f-0f135f67c686") : secret "dns-default-metrics-tls" not found Jun 09 00:21:29.635734 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:29.635677 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2ln75" Jun 09 00:21:51.939601 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:51.939515 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:21:58.180701 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:21:58.180653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:21:58.181152 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:21:58.180765 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:21:58.181152 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:21:58.180830 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs podName:b8681e4f-fd46-4459-a758-86bd8e59af0b nodeName:}" failed. No retries permitted until 2026-06-09 00:24:00.180815501 +0000 UTC m=+252.228542915 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs") pod "network-metrics-daemon-7gn4s" (UID: "b8681e4f-fd46-4459-a758-86bd8e59af0b") : secret "metrics-daemon-secret" not found Jun 09 00:22:12.412084 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.412044 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j"] Jun 09 00:22:12.414039 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.414016 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm"] Jun 09 00:22:12.414202 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.414159 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.415843 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.415820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" Jun 09 00:22:12.419494 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.419471 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 00:22:12.419612 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.419512 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 00:22:12.419612 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.419474 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 00:22:12.419702 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.419622 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qk6l7\"" Jun 09 00:22:12.419878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.419862 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:22:12.430069 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.430053 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8lnjh\"" Jun 09 00:22:12.442883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.442856 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j"] Jun 09 00:22:12.460411 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.460389 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm"] Jun 09 00:22:12.474478 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.474459 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9783c1fb-6218-4a82-9596-4035a4663998-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.474597 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.474487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blvjg\" (UniqueName: \"kubernetes.io/projected/9783c1fb-6218-4a82-9596-4035a4663998-kube-api-access-blvjg\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.474597 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.474507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwxpr\" (UniqueName: \"kubernetes.io/projected/ae2c1d9b-e01a-40f3-8805-028bdde1d891-kube-api-access-zwxpr\") pod \"network-check-source-dbd9cf844-98dbm\" (UID: \"ae2c1d9b-e01a-40f3-8805-028bdde1d891\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" Jun 09 00:22:12.474597 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.474529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9783c1fb-6218-4a82-9596-4035a4663998-config\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.507822 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.507794 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-685f6b5867-hsk68"] Jun 09 00:22:12.509418 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.509402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.511534 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.511514 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 00:22:12.511631 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.511565 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 00:22:12.511631 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.511595 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xd9lg\"" Jun 09 00:22:12.511805 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.511788 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 00:22:12.517482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.517465 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 00:22:12.526171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.526152 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685f6b5867-hsk68"] Jun 09 00:22:12.575785 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.575764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9783c1fb-6218-4a82-9596-4035a4663998-config\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.575869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.575809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-image-registry-private-configuration\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.575869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.575827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-installation-pull-secrets\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.575869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.575861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-bound-sa-token\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.576006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.575984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9319685-3f77-4798-94ca-f4594879a053-ca-trust-extracted\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.576057 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-registry-certificates\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.576107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-trusted-ca\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.576107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.576204 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9783c1fb-6218-4a82-9596-4035a4663998-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.576204 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blvjg\" (UniqueName: \"kubernetes.io/projected/9783c1fb-6218-4a82-9596-4035a4663998-kube-api-access-blvjg\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.576204 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwxpr\" (UniqueName: \"kubernetes.io/projected/ae2c1d9b-e01a-40f3-8805-028bdde1d891-kube-api-access-zwxpr\") pod \"network-check-source-dbd9cf844-98dbm\" (UID: \"ae2c1d9b-e01a-40f3-8805-028bdde1d891\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" Jun 09 00:22:12.576204 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbfpq\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-kube-api-access-rbfpq\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.576335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.576234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9783c1fb-6218-4a82-9596-4035a4663998-config\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.578111 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.578089 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9783c1fb-6218-4a82-9596-4035a4663998-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.587076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.587054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwxpr\" (UniqueName: \"kubernetes.io/projected/ae2c1d9b-e01a-40f3-8805-028bdde1d891-kube-api-access-zwxpr\") pod \"network-check-source-dbd9cf844-98dbm\" (UID: \"ae2c1d9b-e01a-40f3-8805-028bdde1d891\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" Jun 09 00:22:12.590372 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.590352 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blvjg\" (UniqueName: \"kubernetes.io/projected/9783c1fb-6218-4a82-9596-4035a4663998-kube-api-access-blvjg\") pod \"service-ca-operator-6bc5ff68f5-q4r8j\" (UID: \"9783c1fb-6218-4a82-9596-4035a4663998\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.602685 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.602661 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-dhh58"] Jun 09 00:22:12.604480 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.604464 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.606652 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.606633 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 00:22:12.606744 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.606718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:22:12.606801 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.606749 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 00:22:12.606801 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.606773 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 00:22:12.606945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.606921 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hc7h2\"" Jun 09 00:22:12.609812 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.609782 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2"] Jun 09 00:22:12.611495 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.611478 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.613063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.613035 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 00:22:12.613897 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.613878 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 00:22:12.614196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.614179 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-j4zb8\"" Jun 09 00:22:12.614401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.614382 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 00:22:12.614494 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.614389 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 00:22:12.614658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.614643 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 00:22:12.617077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.617057 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-dhh58"] Jun 09 00:22:12.624829 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.624810 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2"] Jun 09 00:22:12.676569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/544f31a5-e323-4667-9b70-3da7e45a10e4-trusted-ca\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.676569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a746fe9-90b3-4ee5-99bc-d796b0baad3c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76ff769b7b-9fgd2\" (UID: \"2a746fe9-90b3-4ee5-99bc-d796b0baad3c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.676709 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-image-registry-private-configuration\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676709 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-installation-pull-secrets\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676709 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-bound-sa-token\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9319685-3f77-4798-94ca-f4594879a053-ca-trust-extracted\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-registry-certificates\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676948 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-trusted-ca\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676948 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.676948 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.676924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsfb4\" (UniqueName: \"kubernetes.io/projected/2a746fe9-90b3-4ee5-99bc-d796b0baad3c-kube-api-access-lsfb4\") pod \"managed-serviceaccount-addon-agent-76ff769b7b-9fgd2\" (UID: \"2a746fe9-90b3-4ee5-99bc-d796b0baad3c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.677098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677046 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9319685-3f77-4798-94ca-f4594879a053-ca-trust-extracted\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.677098 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:12.677056 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:22:12.677098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/544f31a5-e323-4667-9b70-3da7e45a10e4-config\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.677098 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:12.677074 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685f6b5867-hsk68: secret "image-registry-tls" not found Jun 09 00:22:12.677098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/544f31a5-e323-4667-9b70-3da7e45a10e4-serving-cert\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.677287 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:12.677137 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls podName:c9319685-3f77-4798-94ca-f4594879a053 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:13.177119603 +0000 UTC m=+145.224847024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls") pod "image-registry-685f6b5867-hsk68" (UID: "c9319685-3f77-4798-94ca-f4594879a053") : secret "image-registry-tls" not found Jun 09 00:22:12.677287 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp56t\" (UniqueName: \"kubernetes.io/projected/544f31a5-e323-4667-9b70-3da7e45a10e4-kube-api-access-wp56t\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.677287 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbfpq\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-kube-api-access-rbfpq\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.677391 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-registry-certificates\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.677740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.677724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-trusted-ca\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.678718 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.678701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-image-registry-private-configuration\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.678845 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.678830 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-installation-pull-secrets\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.687382 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.687365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbfpq\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-kube-api-access-rbfpq\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.687463 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.687366 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-bound-sa-token\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:12.706127 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.706108 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:12.724084 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.724070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" Jun 09 00:22:12.729184 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.729171 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" Jun 09 00:22:12.759769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.759744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:12.779863 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.779828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a746fe9-90b3-4ee5-99bc-d796b0baad3c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76ff769b7b-9fgd2\" (UID: \"2a746fe9-90b3-4ee5-99bc-d796b0baad3c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.779981 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.779944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsfb4\" (UniqueName: \"kubernetes.io/projected/2a746fe9-90b3-4ee5-99bc-d796b0baad3c-kube-api-access-lsfb4\") pod \"managed-serviceaccount-addon-agent-76ff769b7b-9fgd2\" (UID: \"2a746fe9-90b3-4ee5-99bc-d796b0baad3c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.779981 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.779973 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/544f31a5-e323-4667-9b70-3da7e45a10e4-config\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.780102 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.779995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/544f31a5-e323-4667-9b70-3da7e45a10e4-serving-cert\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.780102 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.780029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp56t\" (UniqueName: \"kubernetes.io/projected/544f31a5-e323-4667-9b70-3da7e45a10e4-kube-api-access-wp56t\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.780102 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.780055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/544f31a5-e323-4667-9b70-3da7e45a10e4-trusted-ca\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.781329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.781287 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/544f31a5-e323-4667-9b70-3da7e45a10e4-config\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.781978 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.781952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/544f31a5-e323-4667-9b70-3da7e45a10e4-trusted-ca\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.785524 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.785478 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/544f31a5-e323-4667-9b70-3da7e45a10e4-serving-cert\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.786493 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.786470 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a746fe9-90b3-4ee5-99bc-d796b0baad3c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76ff769b7b-9fgd2\" (UID: \"2a746fe9-90b3-4ee5-99bc-d796b0baad3c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.789525 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.789498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp56t\" (UniqueName: \"kubernetes.io/projected/544f31a5-e323-4667-9b70-3da7e45a10e4-kube-api-access-wp56t\") pod \"console-operator-668fdbf85c-dhh58\" (UID: \"544f31a5-e323-4667-9b70-3da7e45a10e4\") " pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.789970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.789938 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsfb4\" (UniqueName: \"kubernetes.io/projected/2a746fe9-90b3-4ee5-99bc-d796b0baad3c-kube-api-access-lsfb4\") pod \"managed-serviceaccount-addon-agent-76ff769b7b-9fgd2\" (UID: \"2a746fe9-90b3-4ee5-99bc-d796b0baad3c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:12.845045 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.845019 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j"] Jun 09 00:22:12.848367 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:12.848347 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9783c1fb_6218_4a82_9596_4035a4663998.slice/crio-0861d45a5f0a034f2770ca95f647fe0ef43f2a5d4711c3d6b2b41b1648eb6bbb WatchSource:0}: Error finding container 0861d45a5f0a034f2770ca95f647fe0ef43f2a5d4711c3d6b2b41b1648eb6bbb: Status 404 returned error can't find the container with id 0861d45a5f0a034f2770ca95f647fe0ef43f2a5d4711c3d6b2b41b1648eb6bbb Jun 09 00:22:12.857503 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.857399 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm"] Jun 09 00:22:12.859622 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:12.859591 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2c1d9b_e01a_40f3_8805_028bdde1d891.slice/crio-8ddcf06942d6fac290f055b011efd4a59596e4c63ff860963e90480ef5be2dc7 WatchSource:0}: Error finding container 8ddcf06942d6fac290f055b011efd4a59596e4c63ff860963e90480ef5be2dc7: Status 404 returned error can't find the container with id 8ddcf06942d6fac290f055b011efd4a59596e4c63ff860963e90480ef5be2dc7 Jun 09 00:22:12.913025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.913003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:12.935487 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:12.935428 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" Jun 09 00:22:13.039803 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.039766 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-dhh58"] Jun 09 00:22:13.042527 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:13.042502 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544f31a5_e323_4667_9b70_3da7e45a10e4.slice/crio-cb8b6248f0bf003d881ba1afc92b813616e9a2363bb1982ea2a2c296daa5c7d1 WatchSource:0}: Error finding container cb8b6248f0bf003d881ba1afc92b813616e9a2363bb1982ea2a2c296daa5c7d1: Status 404 returned error can't find the container with id cb8b6248f0bf003d881ba1afc92b813616e9a2363bb1982ea2a2c296daa5c7d1 Jun 09 00:22:13.054970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.054936 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2"] Jun 09 00:22:13.057764 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:13.057741 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a746fe9_90b3_4ee5_99bc_d796b0baad3c.slice/crio-43b5712d8594740165c67f0485811eaa72e6e3fcd8c87da9eae1d2efbd060f93 WatchSource:0}: Error finding container 43b5712d8594740165c67f0485811eaa72e6e3fcd8c87da9eae1d2efbd060f93: Status 404 returned error can't find the container with id 43b5712d8594740165c67f0485811eaa72e6e3fcd8c87da9eae1d2efbd060f93 Jun 09 00:22:13.182453 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.182423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:13.182606 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:13.182590 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:22:13.182676 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:13.182608 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685f6b5867-hsk68: secret "image-registry-tls" not found Jun 09 00:22:13.182676 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:13.182663 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls podName:c9319685-3f77-4798-94ca-f4594879a053 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:14.182644375 +0000 UTC m=+146.230371796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls") pod "image-registry-685f6b5867-hsk68" (UID: "c9319685-3f77-4798-94ca-f4594879a053") : secret "image-registry-tls" not found Jun 09 00:22:13.792856 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.792823 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" event={"ID":"2a746fe9-90b3-4ee5-99bc-d796b0baad3c","Type":"ContainerStarted","Data":"43b5712d8594740165c67f0485811eaa72e6e3fcd8c87da9eae1d2efbd060f93"} Jun 09 00:22:13.794208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.794182 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" event={"ID":"ae2c1d9b-e01a-40f3-8805-028bdde1d891","Type":"ContainerStarted","Data":"4e5d1e4e0e6ca748d08260872d7036a9a7c2dc478550ab0cda6fc8d6f72147f1"} Jun 09 00:22:13.794340 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.794221 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" event={"ID":"ae2c1d9b-e01a-40f3-8805-028bdde1d891","Type":"ContainerStarted","Data":"8ddcf06942d6fac290f055b011efd4a59596e4c63ff860963e90480ef5be2dc7"} Jun 09 00:22:13.795272 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.795251 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" event={"ID":"544f31a5-e323-4667-9b70-3da7e45a10e4","Type":"ContainerStarted","Data":"cb8b6248f0bf003d881ba1afc92b813616e9a2363bb1982ea2a2c296daa5c7d1"} Jun 09 00:22:13.796222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.796202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" event={"ID":"9783c1fb-6218-4a82-9596-4035a4663998","Type":"ContainerStarted","Data":"0861d45a5f0a034f2770ca95f647fe0ef43f2a5d4711c3d6b2b41b1648eb6bbb"} Jun 09 00:22:13.807998 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:13.807958 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-98dbm" podStartSLOduration=1.807942275 podStartE2EDuration="1.807942275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:13.80773709 +0000 UTC m=+145.855464531" watchObservedRunningTime="2026-06-09 00:22:13.807942275 +0000 UTC m=+145.855669690" Jun 09 00:22:14.144156 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:14.144120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:14.190369 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:14.190341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:14.190503 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:14.190472 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:22:14.190503 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:14.190487 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685f6b5867-hsk68: secret "image-registry-tls" not found Jun 09 00:22:14.190628 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:14.190540 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls podName:c9319685-3f77-4798-94ca-f4594879a053 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:16.190524488 +0000 UTC m=+148.238251903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls") pod "image-registry-685f6b5867-hsk68" (UID: "c9319685-3f77-4798-94ca-f4594879a053") : secret "image-registry-tls" not found Jun 09 00:22:15.805453 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:15.805407 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/0.log" Jun 09 00:22:15.805908 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:15.805479 2572 generic.go:356] "Generic (PLEG): container finished" podID="544f31a5-e323-4667-9b70-3da7e45a10e4" containerID="a36787157d70cc55be4e62ea16bd9cff4747320c947a803f7ad863f8313490ac" exitCode=255 Jun 09 00:22:15.805908 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:15.805581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" event={"ID":"544f31a5-e323-4667-9b70-3da7e45a10e4","Type":"ContainerDied","Data":"a36787157d70cc55be4e62ea16bd9cff4747320c947a803f7ad863f8313490ac"} Jun 09 00:22:15.806963 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:15.806242 2572 scope.go:117] "RemoveContainer" containerID="a36787157d70cc55be4e62ea16bd9cff4747320c947a803f7ad863f8313490ac" Jun 09 00:22:15.811818 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:15.811795 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" event={"ID":"9783c1fb-6218-4a82-9596-4035a4663998","Type":"ContainerStarted","Data":"cbd13004b1809fbdbc4b9f1ec1cb557e78e01640f0fcbce9d28932eec959216e"} Jun 09 00:22:15.835168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:15.835124 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" podStartSLOduration=1.303988598 podStartE2EDuration="3.835108104s" totalImagesPullingTime="2.531119506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:15.833665459 +0000 UTC m=+147.881392894" watchObservedRunningTime="2026-06-09 00:22:15.835108104 +0000 UTC m=+147.882835542" Jun 09 00:22:16.203975 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.203937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:16.204116 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:16.204091 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:22:16.204116 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:16.204111 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685f6b5867-hsk68: secret "image-registry-tls" not found Jun 09 00:22:16.204218 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:16.204188 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls podName:c9319685-3f77-4798-94ca-f4594879a053 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:20.204166305 +0000 UTC m=+152.251893740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls") pod "image-registry-685f6b5867-hsk68" (UID: "c9319685-3f77-4798-94ca-f4594879a053") : secret "image-registry-tls" not found Jun 09 00:22:16.556710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.556625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:16.651276 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.651240 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:16.748201 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.748167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:16.796525 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.796494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:16.817186 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.817130 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:22:16.817598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.817580 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/0.log" Jun 09 00:22:16.817706 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.817617 2572 generic.go:356] "Generic (PLEG): container finished" podID="544f31a5-e323-4667-9b70-3da7e45a10e4" containerID="461c20b55656ebf8bd15f1cd71a2282df73523a8e07863e503656d9b8bab50f8" exitCode=255 Jun 09 00:22:16.817706 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.817650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" event={"ID":"544f31a5-e323-4667-9b70-3da7e45a10e4","Type":"ContainerDied","Data":"461c20b55656ebf8bd15f1cd71a2282df73523a8e07863e503656d9b8bab50f8"} Jun 09 00:22:16.817805 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.817717 2572 scope.go:117] "RemoveContainer" containerID="a36787157d70cc55be4e62ea16bd9cff4747320c947a803f7ad863f8313490ac" Jun 09 00:22:16.817990 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:16.817954 2572 scope.go:117] "RemoveContainer" containerID="461c20b55656ebf8bd15f1cd71a2282df73523a8e07863e503656d9b8bab50f8" Jun 09 00:22:16.818145 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:16.818125 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-dhh58_openshift-console-operator(544f31a5-e323-4667-9b70-3da7e45a10e4)\"" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" podUID="544f31a5-e323-4667-9b70-3da7e45a10e4" Jun 09 00:22:17.389005 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:17.388979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:17.490318 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:17.490293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:17.822518 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:17.822422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" event={"ID":"2a746fe9-90b3-4ee5-99bc-d796b0baad3c","Type":"ContainerStarted","Data":"4fe0f54fd05f9f8829f169d54bf7557ba6f417a7d6920b0b7e8440ca9f9d5624"} Jun 09 00:22:17.824344 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:17.824321 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:22:17.824658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:17.824640 2572 scope.go:117] "RemoveContainer" containerID="461c20b55656ebf8bd15f1cd71a2282df73523a8e07863e503656d9b8bab50f8" Jun 09 00:22:17.824822 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:17.824802 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-dhh58_openshift-console-operator(544f31a5-e323-4667-9b70-3da7e45a10e4)\"" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" podUID="544f31a5-e323-4667-9b70-3da7e45a10e4" Jun 09 00:22:17.835717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:17.835643 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76ff769b7b-9fgd2" podStartSLOduration=1.786325953 podStartE2EDuration="5.835624526s" totalImagesPullingTime="4.049298573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:17.835105983 +0000 UTC m=+149.882833418" watchObservedRunningTime="2026-06-09 00:22:17.835624526 +0000 UTC m=+149.883351962" Jun 09 00:22:18.985634 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.985604 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-mnl2l"] Jun 09 00:22:18.987400 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.987383 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:18.989752 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.989727 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 00:22:18.989853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.989752 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 00:22:18.989853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.989811 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qrxfr\"" Jun 09 00:22:18.990503 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.990477 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 00:22:18.990638 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.990544 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 00:22:18.998361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:18.998330 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-mnl2l"] Jun 09 00:22:19.024580 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.024539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:19.073360 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.073336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:19.126429 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.126404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d90467f-9dca-4cb2-bf81-bce36e837a16-signing-key\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.126527 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.126448 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d90467f-9dca-4cb2-bf81-bce36e837a16-signing-cabundle\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.126527 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.126485 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kc2m\" (UniqueName: \"kubernetes.io/projected/4d90467f-9dca-4cb2-bf81-bce36e837a16-kube-api-access-2kc2m\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.164602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.164580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:19.226755 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.226729 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d90467f-9dca-4cb2-bf81-bce36e837a16-signing-cabundle\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.226819 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.226772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kc2m\" (UniqueName: \"kubernetes.io/projected/4d90467f-9dca-4cb2-bf81-bce36e837a16-kube-api-access-2kc2m\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.226870 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.226817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d90467f-9dca-4cb2-bf81-bce36e837a16-signing-key\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.227360 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.227340 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d90467f-9dca-4cb2-bf81-bce36e837a16-signing-cabundle\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.229235 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.229212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d90467f-9dca-4cb2-bf81-bce36e837a16-signing-key\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.234638 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.234614 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kc2m\" (UniqueName: \"kubernetes.io/projected/4d90467f-9dca-4cb2-bf81-bce36e837a16-kube-api-access-2kc2m\") pod \"service-ca-7d74d578b8-mnl2l\" (UID: \"4d90467f-9dca-4cb2-bf81-bce36e837a16\") " pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.296281 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.296228 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" Jun 09 00:22:19.415171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.415081 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-mnl2l"] Jun 09 00:22:19.417456 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:19.417432 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d90467f_9dca_4cb2_bf81_bce36e837a16.slice/crio-0c08aac58ca6bf46bc90a9e8121d82c0dea520d487734e916b317c71ec85bbb1 WatchSource:0}: Error finding container 0c08aac58ca6bf46bc90a9e8121d82c0dea520d487734e916b317c71ec85bbb1: Status 404 returned error can't find the container with id 0c08aac58ca6bf46bc90a9e8121d82c0dea520d487734e916b317c71ec85bbb1 Jun 09 00:22:19.831465 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.831438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" event={"ID":"4d90467f-9dca-4cb2-bf81-bce36e837a16","Type":"ContainerStarted","Data":"4b77d5e5cda8fb2825ad0fc5a0d985c47be5c35585243372b34f38010930c0a6"} Jun 09 00:22:19.831609 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.831478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" event={"ID":"4d90467f-9dca-4cb2-bf81-bce36e837a16","Type":"ContainerStarted","Data":"0c08aac58ca6bf46bc90a9e8121d82c0dea520d487734e916b317c71ec85bbb1"} Jun 09 00:22:19.835406 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.835387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:19.847665 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:19.847624 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-mnl2l" podStartSLOduration=1.84760944 podStartE2EDuration="1.84760944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:19.846651864 +0000 UTC m=+151.894379301" watchObservedRunningTime="2026-06-09 00:22:19.84760944 +0000 UTC m=+151.895336875" Jun 09 00:22:20.036131 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:20.036112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:20.136756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:20.136692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:20.233453 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:20.233433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:20.233579 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:20.233566 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 00:22:20.233623 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:20.233581 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685f6b5867-hsk68: secret "image-registry-tls" not found Jun 09 00:22:20.233623 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:20.233621 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls podName:c9319685-3f77-4798-94ca-f4594879a053 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:28.233610203 +0000 UTC m=+160.281337617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls") pod "image-registry-685f6b5867-hsk68" (UID: "c9319685-3f77-4798-94ca-f4594879a053") : secret "image-registry-tls" not found Jun 09 00:22:21.143771 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.143739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:21.246976 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.246940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:21.438816 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.438749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:21.555452 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.555424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:21.650902 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.650859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:21.841587 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.841479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:21.921957 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:21.921937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7nxx4_f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e/dns-node-resolver/0.log" Jun 09 00:22:22.153051 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:22.153026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:22.722793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:22.722772 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-65qx9_22cbcf86-045d-44a1-83eb-8e72075b34ec/node-ca/0.log" Jun 09 00:22:22.913970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:22.913943 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:22.914078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:22.913988 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:22.914314 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:22.914301 2572 scope.go:117] "RemoveContainer" containerID="461c20b55656ebf8bd15f1cd71a2282df73523a8e07863e503656d9b8bab50f8" Jun 09 00:22:22.914483 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:22.914463 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-dhh58_openshift-console-operator(544f31a5-e323-4667-9b70-3da7e45a10e4)\"" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" podUID="544f31a5-e323-4667-9b70-3da7e45a10e4" Jun 09 00:22:23.052472 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:23.052410 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:23.241672 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:23.241637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:23.455508 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:23.455487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:23.646201 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:23.646178 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:23.721975 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:23.721910 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mm2kn_fe5c5b78-815b-4253-9117-86114688727a/serve-healthcheck-canary/0.log" Jun 09 00:22:23.841627 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:23.841610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:24.848191 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:24.848159 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:25.036876 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:25.036853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:25.085294 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:25.085273 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:25.240884 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:25.240865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:25.443589 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:25.443570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:25.636746 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:25.636701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:25.840707 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:25.840688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:26.323102 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:26.323071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:27.044004 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:27.043978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:27.243948 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:27.243926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:27.440240 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:27.440220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:27.565634 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:27.565618 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:27.665783 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:27.665736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:27.840129 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:27.840076 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:28.286817 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.286793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:28.288821 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.288804 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"image-registry-685f6b5867-hsk68\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:28.323547 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:28.323519 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-crtmw" podUID="3f27364c-dd01-416e-832f-0f135f67c686" Jun 09 00:22:28.385684 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:28.385660 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7gn4s" podUID="b8681e4f-fd46-4459-a758-86bd8e59af0b" Jun 09 00:22:28.418126 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.418106 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:28.530023 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.529991 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685f6b5867-hsk68"] Jun 09 00:22:28.534195 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:28.534170 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9319685_3f77_4798_94ca_f4594879a053.slice/crio-ed2620c80b6c2fb8328295e74d0f44796838baed280e65b6d0a6eb0a33c22f09 WatchSource:0}: Error finding container ed2620c80b6c2fb8328295e74d0f44796838baed280e65b6d0a6eb0a33c22f09: Status 404 returned error can't find the container with id ed2620c80b6c2fb8328295e74d0f44796838baed280e65b6d0a6eb0a33c22f09 Jun 09 00:22:28.653458 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.653430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:28.861431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.861358 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" event={"ID":"c9319685-3f77-4798-94ca-f4594879a053","Type":"ContainerStarted","Data":"279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b"} Jun 09 00:22:28.861431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.861379 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crtmw" Jun 09 00:22:28.861431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.861407 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" event={"ID":"c9319685-3f77-4798-94ca-f4594879a053","Type":"ContainerStarted","Data":"ed2620c80b6c2fb8328295e74d0f44796838baed280e65b6d0a6eb0a33c22f09"} Jun 09 00:22:28.883631 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:28.883582 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" podStartSLOduration=16.883548929 podStartE2EDuration="16.883548929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:28.883410846 +0000 UTC m=+160.931138276" watchObservedRunningTime="2026-06-09 00:22:28.883548929 +0000 UTC m=+160.931276365" Jun 09 00:22:29.041290 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:29.041265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:29.441249 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:29.441218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:29.633150 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:29.633122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:29.840268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:29.840208 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:29.864931 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:29.864914 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:30.249528 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:30.249504 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:30.641917 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:30.641894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:30.844145 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:30.844128 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:31.069542 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:31.069482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:31.140930 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:31.140903 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:31.224238 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:31.224215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:31.322895 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:31.322849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:31.641912 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:31.641891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:32.056020 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:32.055957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:32.247197 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:32.247174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:33.221197 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:33.221171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:22:33.223336 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:33.223314 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f27364c-dd01-416e-832f-0f135f67c686-metrics-tls\") pod \"dns-default-crtmw\" (UID: \"3f27364c-dd01-416e-832f-0f135f67c686\") " pod="openshift-dns/dns-default-crtmw" Jun 09 00:22:33.364169 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:33.364145 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hfdgk\"" Jun 09 00:22:33.372695 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:33.372678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crtmw" Jun 09 00:22:33.492153 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:33.492084 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crtmw"] Jun 09 00:22:33.494317 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:33.494286 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f27364c_dd01_416e_832f_0f135f67c686.slice/crio-f11487d8d13a214096166c2540621e7e201742eb109ca3ba732bd9b1902d8ed1 WatchSource:0}: Error finding container f11487d8d13a214096166c2540621e7e201742eb109ca3ba732bd9b1902d8ed1: Status 404 returned error can't find the container with id f11487d8d13a214096166c2540621e7e201742eb109ca3ba732bd9b1902d8ed1 Jun 09 00:22:33.885442 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:33.885373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crtmw" event={"ID":"3f27364c-dd01-416e-832f-0f135f67c686","Type":"ContainerStarted","Data":"f11487d8d13a214096166c2540621e7e201742eb109ca3ba732bd9b1902d8ed1"} Jun 09 00:22:35.894422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:35.894389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crtmw" event={"ID":"3f27364c-dd01-416e-832f-0f135f67c686","Type":"ContainerStarted","Data":"ace1fc036e390fd9fc1c54af4a3bf023b16d66e82f6646a8df1a97871ae10ca0"} Jun 09 00:22:35.894777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:35.894446 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crtmw" event={"ID":"3f27364c-dd01-416e-832f-0f135f67c686","Type":"ContainerStarted","Data":"b3f8eac2016573df13d9030ef2a33269dea5143b2599b1c56c9bd52706aedf82"} Jun 09 00:22:35.894777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:35.894529 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-crtmw" Jun 09 00:22:38.379315 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:38.379288 2572 scope.go:117] "RemoveContainer" containerID="461c20b55656ebf8bd15f1cd71a2282df73523a8e07863e503656d9b8bab50f8" Jun 09 00:22:38.905972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:38.905948 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:22:38.906098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:38.906030 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" event={"ID":"544f31a5-e323-4667-9b70-3da7e45a10e4","Type":"ContainerStarted","Data":"e136494737f72326aa8750f05af2fc6813a167d9e9ebdd29deb60e53a53f9b77"} Jun 09 00:22:38.906326 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:38.906307 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:38.923416 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:38.923371 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-crtmw" podStartSLOduration=132.342559913 podStartE2EDuration="2m13.923353638s" totalImagesPullingTime="1.580793725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:35.909894189 +0000 UTC m=+167.957621626" watchObservedRunningTime="2026-06-09 00:22:38.923353638 +0000 UTC m=+170.971081073" Jun 09 00:22:38.923934 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:38.923906 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" podStartSLOduration=24.588761093 podStartE2EDuration="26.923892999s" totalImagesPullingTime="2.335131906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:38.923191662 +0000 UTC m=+170.970919098" watchObservedRunningTime="2026-06-09 00:22:38.923892999 +0000 UTC m=+170.971620434" Jun 09 00:22:39.164212 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.164162 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-dhh58" Jun 09 00:22:39.352991 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.352959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:39.454269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.454207 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:39.554777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.554754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:39.655096 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.655075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:39.755446 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.755389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:39.855590 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:39.855549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:40.213968 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:40.213942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:40.821905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:40.821880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:41.024615 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.024592 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:41.125435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.125386 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:41.641163 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.641139 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6g5jv"] Jun 09 00:22:41.646125 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.646102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.648538 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.648515 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 00:22:41.648662 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.648515 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 00:22:41.649655 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.649627 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 00:22:41.649791 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.649761 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9rrnb\"" Jun 09 00:22:41.650050 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.649768 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 00:22:41.655585 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.655536 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6g5jv"] Jun 09 00:22:41.681029 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.681005 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685f6b5867-hsk68"] Jun 09 00:22:41.702126 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.702105 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr"] Jun 09 00:22:41.707078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.707058 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cd49848c-d4b45"] Jun 09 00:22:41.707192 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.707174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:41.709132 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.709117 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.709607 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.709533 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pwt6n\"" Jun 09 00:22:41.709607 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.709604 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 00:22:41.715468 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.715448 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr"] Jun 09 00:22:41.719382 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.719363 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd49848c-d4b45"] Jun 09 00:22:41.773348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-registry-certificates\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773418 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbjw\" (UniqueName: \"kubernetes.io/projected/58178691-8892-4cee-8b61-ab7a5ccbd191-kube-api-access-2fbjw\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.773418 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8s8c\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-kube-api-access-n8s8c\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58178691-8892-4cee-8b61-ab7a5ccbd191-data-volume\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.773521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e076b570-2aef-4479-938d-02acd40d0ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-zs7wr\" (UID: \"e076b570-2aef-4479-938d-02acd40d0ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:41.773521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58178691-8892-4cee-8b61-ab7a5ccbd191-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.773521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773470 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-bound-sa-token\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58178691-8892-4cee-8b61-ab7a5ccbd191-crio-socket\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.773769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-ca-trust-extracted\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58178691-8892-4cee-8b61-ab7a5ccbd191-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.773769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-image-registry-private-configuration\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-trusted-ca\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-registry-tls\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.773960 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.773786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-installation-pull-secrets\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.804594 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.804574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:41.874199 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874176 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58178691-8892-4cee-8b61-ab7a5ccbd191-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-image-registry-private-configuration\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-trusted-ca\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874251 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-registry-tls\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874346 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-installation-pull-secrets\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-registry-certificates\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbjw\" (UniqueName: \"kubernetes.io/projected/58178691-8892-4cee-8b61-ab7a5ccbd191-kube-api-access-2fbjw\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8s8c\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-kube-api-access-n8s8c\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58178691-8892-4cee-8b61-ab7a5ccbd191-data-volume\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.874523 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e076b570-2aef-4479-938d-02acd40d0ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-zs7wr\" (UID: \"e076b570-2aef-4479-938d-02acd40d0ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:41.875005 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58178691-8892-4cee-8b61-ab7a5ccbd191-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.875005 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-bound-sa-token\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.875005 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58178691-8892-4cee-8b61-ab7a5ccbd191-crio-socket\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.875005 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.874654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-ca-trust-extracted\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.875443 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.875420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-ca-trust-extracted\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.875611 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.875465 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-trusted-ca\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.875727 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.875631 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58178691-8892-4cee-8b61-ab7a5ccbd191-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.875878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.875862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58178691-8892-4cee-8b61-ab7a5ccbd191-crio-socket\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.876096 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.876068 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-registry-certificates\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.876329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.876302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58178691-8892-4cee-8b61-ab7a5ccbd191-data-volume\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.877070 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.877043 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58178691-8892-4cee-8b61-ab7a5ccbd191-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.877168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.877049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-image-registry-private-configuration\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.877168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.877135 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-registry-tls\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.877269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.877199 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-installation-pull-secrets\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.877269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.877251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e076b570-2aef-4479-938d-02acd40d0ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-zs7wr\" (UID: \"e076b570-2aef-4479-938d-02acd40d0ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:41.881674 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.881651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-bound-sa-token\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.883475 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.883444 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8s8c\" (UniqueName: \"kubernetes.io/projected/0312a2c2-2dd2-474a-bf39-3a6d4a7b3373-kube-api-access-n8s8c\") pod \"image-registry-7cd49848c-d4b45\" (UID: \"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373\") " pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:41.883642 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.883621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbjw\" (UniqueName: \"kubernetes.io/projected/58178691-8892-4cee-8b61-ab7a5ccbd191-kube-api-access-2fbjw\") pod \"insights-runtime-extractor-6g5jv\" (UID: \"58178691-8892-4cee-8b61-ab7a5ccbd191\") " pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:41.904622 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.904571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:41.956952 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:41.956931 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6g5jv" Jun 09 00:22:42.020084 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.019794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:42.026888 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.026831 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:42.111437 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.111282 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6g5jv"] Jun 09 00:22:42.114744 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:42.114697 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58178691_8892_4cee_8b61_ab7a5ccbd191.slice/crio-93251f9817fd46417ca7a7e412cb24dafecf06deaa74e1c76d305b821a5da7d8 WatchSource:0}: Error finding container 93251f9817fd46417ca7a7e412cb24dafecf06deaa74e1c76d305b821a5da7d8: Status 404 returned error can't find the container with id 93251f9817fd46417ca7a7e412cb24dafecf06deaa74e1c76d305b821a5da7d8 Jun 09 00:22:42.158159 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.158132 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd49848c-d4b45"] Jun 09 00:22:42.161199 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:42.161174 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0312a2c2_2dd2_474a_bf39_3a6d4a7b3373.slice/crio-87e9f57cb23c5e388afb6653ec839f4168f20e4510c99ba9b5b01c9ac172c04b WatchSource:0}: Error finding container 87e9f57cb23c5e388afb6653ec839f4168f20e4510c99ba9b5b01c9ac172c04b: Status 404 returned error can't find the container with id 87e9f57cb23c5e388afb6653ec839f4168f20e4510c99ba9b5b01c9ac172c04b Jun 09 00:22:42.173253 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.173229 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr"] Jun 09 00:22:42.239112 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.239088 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:42.378074 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.378040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:22:42.921165 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.921127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" event={"ID":"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373","Type":"ContainerStarted","Data":"2fd2b928988b8160965a2acbad03f2a817280597da36a06352d881c1bafa0ca9"} Jun 09 00:22:42.921514 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.921193 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" event={"ID":"0312a2c2-2dd2-474a-bf39-3a6d4a7b3373","Type":"ContainerStarted","Data":"87e9f57cb23c5e388afb6653ec839f4168f20e4510c99ba9b5b01c9ac172c04b"} Jun 09 00:22:42.921514 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.921280 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:22:42.922255 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.922232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" event={"ID":"e076b570-2aef-4479-938d-02acd40d0ff1","Type":"ContainerStarted","Data":"f3d432cac4ca9404f4f0e879f76fd89ac71c6b136054c4b440a6e6854ac40c2a"} Jun 09 00:22:42.924026 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.924007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g5jv" event={"ID":"58178691-8892-4cee-8b61-ab7a5ccbd191","Type":"ContainerStarted","Data":"46563123bd0eb6d578967a5a196fad54aafd8002792f394af1f8a03bfe8a8d2f"} Jun 09 00:22:42.924131 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.924044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g5jv" event={"ID":"58178691-8892-4cee-8b61-ab7a5ccbd191","Type":"ContainerStarted","Data":"52cdec3c9fa186adfb8456b447c7bd344995722b7836ad6d42a195cc1b84f360"} Jun 09 00:22:42.924131 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.924061 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g5jv" event={"ID":"58178691-8892-4cee-8b61-ab7a5ccbd191","Type":"ContainerStarted","Data":"93251f9817fd46417ca7a7e412cb24dafecf06deaa74e1c76d305b821a5da7d8"} Jun 09 00:22:42.939763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:42.939725 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" podStartSLOduration=1.939711905 podStartE2EDuration="1.939711905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:42.938609415 +0000 UTC m=+174.986336869" watchObservedRunningTime="2026-06-09 00:22:42.939711905 +0000 UTC m=+174.987439373" Jun 09 00:22:43.029602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:43.029523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:43.080458 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:43.080435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:43.928881 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:43.928844 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" event={"ID":"e076b570-2aef-4479-938d-02acd40d0ff1","Type":"ContainerStarted","Data":"3bab2260711efca8dc9c13c8c5541aeaa858fc811faac1d3deb678e85badc11b"} Jun 09 00:22:43.929307 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:43.929296 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:43.934628 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:43.934604 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" Jun 09 00:22:43.943925 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:43.943888 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zs7wr" podStartSLOduration=1.96425982 podStartE2EDuration="2.943872716s" totalImagesPullingTime="979.612896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:43.942662347 +0000 UTC m=+175.990389785" watchObservedRunningTime="2026-06-09 00:22:43.943872716 +0000 UTC m=+175.991600151" Jun 09 00:22:44.259155 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:44.259085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:44.319782 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:44.319761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:44.612262 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:44.612210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:44.935858 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:44.935823 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g5jv" event={"ID":"58178691-8892-4cee-8b61-ab7a5ccbd191","Type":"ContainerStarted","Data":"eb8d9ccf925eebb31ca852ffbabb62b4545509e82835f63f8949c87f531b7718"} Jun 09 00:22:44.951289 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:44.951245 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6g5jv" podStartSLOduration=1.888310194 podStartE2EDuration="3.95123036s" totalImagesPullingTime="2.062920166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:22:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:44.950772646 +0000 UTC m=+176.998500088" watchObservedRunningTime="2026-06-09 00:22:44.95123036 +0000 UTC m=+176.998957795" Jun 09 00:22:45.900514 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:45.900487 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-crtmw" Jun 09 00:22:46.293120 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:46.293049 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:46.351052 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:46.351022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:46.401409 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:46.401385 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:47.275403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:47.275372 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.382856 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.382815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.592436 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.592392 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.621321 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.621295 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb"] Jun 09 00:22:48.626238 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.626212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.628404 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.628384 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 00:22:48.628702 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.628683 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 00:22:48.628872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.628688 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 00:22:48.629383 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.629367 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 00:22:48.629472 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.629459 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2q85s\"" Jun 09 00:22:48.629579 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.629547 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 00:22:48.633870 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.633634 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kkch8"] Jun 09 00:22:48.636920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.636899 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.637889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.637864 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb"] Jun 09 00:22:48.639072 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.639050 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 00:22:48.639165 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.639127 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 00:22:48.639296 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.639280 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-htc22\"" Jun 09 00:22:48.639763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.639745 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 00:22:48.681838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.681815 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdf7d6f78-cqrks"] Jun 09 00:22:48.684371 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.684351 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.684846 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.684830 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.687250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.686980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 00:22:48.687250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687004 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 00:22:48.687380 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687323 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 00:22:48.687428 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687380 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 00:22:48.687474 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687445 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 00:22:48.687609 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687594 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ltrfd\"" Jun 09 00:22:48.687666 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687604 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 00:22:48.687712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.687660 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 00:22:48.695920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.695898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdf7d6f78-cqrks"] Jun 09 00:22:48.724254 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.724372 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-root\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724372 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724293 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-sys\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724372 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724317 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-textfile\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724372 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpcd7\" (UniqueName: \"kubernetes.io/projected/3c1199d4-36c5-4883-a05f-4565d5d9df49-kube-api-access-dpcd7\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.724591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4c5\" (UniqueName: \"kubernetes.io/projected/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-kube-api-access-lq4c5\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.724754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724592 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-wtmp\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.724754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-tls\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c1199d4-36c5-4883-a05f-4565d5d9df49-metrics-client-ca\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.724754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.724701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.755175 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.755142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.825784 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.825889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-root\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.825889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-sys\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.825889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-oauth-config\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.825889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-textfile\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825904 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-root\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:48.825914 2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-service-ca\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:48.825966 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls podName:e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac nodeName:}" failed. No retries permitted until 2026-06-09 00:22:49.32595399 +0000 UTC m=+181.373681405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-fx6fb" (UID: "e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac") : secret "openshift-state-metrics-tls" not found Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.825915 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-sys\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-console-config\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.826078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpcd7\" (UniqueName: \"kubernetes.io/projected/3c1199d4-36c5-4883-a05f-4565d5d9df49-kube-api-access-dpcd7\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4c5\" (UniqueName: \"kubernetes.io/projected/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-kube-api-access-lq4c5\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc65r\" (UniqueName: \"kubernetes.io/projected/67f14452-a99c-4945-9ea6-e900dc5a2801-kube-api-access-dc65r\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-textfile\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-wtmp\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-tls\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c1199d4-36c5-4883-a05f-4565d5d9df49-metrics-client-ca\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826305 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:48.826328 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-serving-cert\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.826447 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:48.826372 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-tls podName:3c1199d4-36c5-4883-a05f-4565d5d9df49 nodeName:}" failed. No retries permitted until 2026-06-09 00:22:49.326356833 +0000 UTC m=+181.374084253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-tls") pod "node-exporter-kkch8" (UID: "3c1199d4-36c5-4883-a05f-4565d5d9df49") : secret "node-exporter-tls" not found Jun 09 00:22:48.827009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-wtmp\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.827009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.827009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-oauth-serving-cert\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.827009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826899 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c1199d4-36c5-4883-a05f-4565d5d9df49-metrics-client-ca\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.827009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.826976 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.828625 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.828607 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.828959 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.828940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.834375 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.834350 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4c5\" (UniqueName: \"kubernetes.io/projected/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-kube-api-access-lq4c5\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:48.834807 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.834788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpcd7\" (UniqueName: \"kubernetes.io/projected/3c1199d4-36c5-4883-a05f-4565d5d9df49-kube-api-access-dpcd7\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:48.858635 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.858583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.927217 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927195 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-serving-cert\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.927342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-oauth-serving-cert\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.927342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-oauth-config\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.927342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-service-ca\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.927486 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-console-config\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.927486 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc65r\" (UniqueName: \"kubernetes.io/projected/67f14452-a99c-4945-9ea6-e900dc5a2801-kube-api-access-dc65r\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.927984 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.927961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-oauth-serving-cert\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.928233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.928206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-console-config\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.928392 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.928376 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-service-ca\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.930731 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.930710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-serving-cert\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.931662 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.931640 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-oauth-config\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.935250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.935230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc65r\" (UniqueName: \"kubernetes.io/projected/67f14452-a99c-4945-9ea6-e900dc5a2801-kube-api-access-dc65r\") pod \"console-6fdf7d6f78-cqrks\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:48.956931 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.956906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:48.994079 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:48.994051 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:49.124821 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.124798 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdf7d6f78-cqrks"] Jun 09 00:22:49.126533 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.126491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:49.127072 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:49.127052 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f14452_a99c_4945_9ea6_e900dc5a2801.slice/crio-b26c9bb35e415b2f52dd4cb8668d4f1d8020aad812e5fbcf5712ce5f74976ad5 WatchSource:0}: Error finding container b26c9bb35e415b2f52dd4cb8668d4f1d8020aad812e5fbcf5712ce5f74976ad5: Status 404 returned error can't find the container with id b26c9bb35e415b2f52dd4cb8668d4f1d8020aad812e5fbcf5712ce5f74976ad5 Jun 09 00:22:49.226486 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.226430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:49.330585 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.330546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:49.330671 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.330625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-tls\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:49.330671 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:49.330663 2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 00:22:49.330738 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:22:49.330725 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls podName:e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac nodeName:}" failed. No retries permitted until 2026-06-09 00:22:50.330707443 +0000 UTC m=+182.378434864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-fx6fb" (UID: "e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac") : secret "openshift-state-metrics-tls" not found Jun 09 00:22:49.332515 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.332495 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c1199d4-36c5-4883-a05f-4565d5d9df49-node-exporter-tls\") pod \"node-exporter-kkch8\" (UID: \"3c1199d4-36c5-4883-a05f-4565d5d9df49\") " pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:49.427177 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.427150 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:49.547164 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.547118 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkch8" Jun 09 00:22:49.562092 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:49.562067 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1199d4_36c5_4883_a05f_4565d5d9df49.slice/crio-18148c2312fb07683b45b9c2ae90f0f515f2344e02d4eb169d174b55a352cc19 WatchSource:0}: Error finding container 18148c2312fb07683b45b9c2ae90f0f515f2344e02d4eb169d174b55a352cc19: Status 404 returned error can't find the container with id 18148c2312fb07683b45b9c2ae90f0f515f2344e02d4eb169d174b55a352cc19 Jun 09 00:22:49.604064 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.604042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:49.683597 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.683580 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:22:49.685662 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.685644 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:49.688263 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.688248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.690418 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 00:22:49.690543 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690521 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 00:22:49.690796 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690773 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 00:22:49.690878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690820 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 00:22:49.690878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690828 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r5m2j\"" Jun 09 00:22:49.690878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690775 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 00:22:49.691024 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.690825 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 00:22:49.691125 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.691107 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 00:22:49.691212 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.691148 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 00:22:49.691212 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.691156 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 00:22:49.703180 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.703161 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:22:49.834671 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834671 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpj68\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-kube-api-access-gpj68\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-web-config\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-out\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834940 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834940 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-volume\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.834997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.834989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.835079 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.835015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.835126 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.835085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.835164 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.835127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.921027 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.921000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:49.936067 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpj68\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-kube-api-access-gpj68\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-web-config\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936222 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-out\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936285 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-volume\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.936926 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.936726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.938057 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.938034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.939238 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.938634 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.940829 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.940433 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.941473 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.941424 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.941759 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.941732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.941844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.941787 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-volume\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.941844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.941811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.942098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.942059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.942192 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.942155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-web-config\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.943492 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.942231 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.944343 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.944206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-out\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.950444 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.948689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpj68\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-kube-api-access-gpj68\") pod \"alertmanager-main-0\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:49.956507 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.956456 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkch8" event={"ID":"3c1199d4-36c5-4883-a05f-4565d5d9df49","Type":"ContainerStarted","Data":"18148c2312fb07683b45b9c2ae90f0f515f2344e02d4eb169d174b55a352cc19"} Jun 09 00:22:49.957941 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.957898 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdf7d6f78-cqrks" event={"ID":"67f14452-a99c-4945-9ea6-e900dc5a2801","Type":"ContainerStarted","Data":"b26c9bb35e415b2f52dd4cb8668d4f1d8020aad812e5fbcf5712ce5f74976ad5"} Jun 09 00:22:49.997296 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:49.997275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:22:50.140571 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.140528 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:22:50.144186 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:50.144156 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda80922c_d2ad_4c47_be3b_758eb677fd0e.slice/crio-2f71f8b0722d1ac33a23dc253af2c3423fd26cff4072905a30c9e20712548322 WatchSource:0}: Error finding container 2f71f8b0722d1ac33a23dc253af2c3423fd26cff4072905a30c9e20712548322: Status 404 returned error can't find the container with id 2f71f8b0722d1ac33a23dc253af2c3423fd26cff4072905a30c9e20712548322 Jun 09 00:22:50.339265 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.339234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:50.342017 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.341988 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fx6fb\" (UID: \"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:50.437393 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.437371 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" Jun 09 00:22:50.564366 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.564344 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb"] Jun 09 00:22:50.598528 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:50.598470 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89d3047_4d4e_4aa0_b4bd_93b2c2aa7fac.slice/crio-8f9494e6d3f9a7d6c3e73114a73c6e5fc8314be69e1ca1863f34a34143487a85 WatchSource:0}: Error finding container 8f9494e6d3f9a7d6c3e73114a73c6e5fc8314be69e1ca1863f34a34143487a85: Status 404 returned error can't find the container with id 8f9494e6d3f9a7d6c3e73114a73c6e5fc8314be69e1ca1863f34a34143487a85 Jun 09 00:22:50.963718 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.963645 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c1199d4-36c5-4883-a05f-4565d5d9df49" containerID="057b2d269283071de36e2fac052554c036dd8f9ec1d8c77b86bd8c62fb174a57" exitCode=0 Jun 09 00:22:50.963862 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.963739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkch8" event={"ID":"3c1199d4-36c5-4883-a05f-4565d5d9df49","Type":"ContainerDied","Data":"057b2d269283071de36e2fac052554c036dd8f9ec1d8c77b86bd8c62fb174a57"} Jun 09 00:22:50.965369 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.965349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"2f71f8b0722d1ac33a23dc253af2c3423fd26cff4072905a30c9e20712548322"} Jun 09 00:22:50.967498 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.967461 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" event={"ID":"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac","Type":"ContainerStarted","Data":"91fef6747f417392ee249e2eda3539a475f82898571b8485c8e46dfb92577e82"} Jun 09 00:22:50.967623 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.967519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" event={"ID":"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac","Type":"ContainerStarted","Data":"12527a581128de10deac720191d7b43b94cafee12670bbd610762fc9a0279343"} Jun 09 00:22:50.967623 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:50.967547 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" event={"ID":"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac","Type":"ContainerStarted","Data":"8f9494e6d3f9a7d6c3e73114a73c6e5fc8314be69e1ca1863f34a34143487a85"} Jun 09 00:22:51.579024 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.578932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:51.605356 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.605331 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-766675688d-4pfm9"] Jun 09 00:22:51.609365 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.609346 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.611906 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.611881 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 00:22:51.611906 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.611903 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 00:22:51.611906 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.611882 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 00:22:51.612114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.611934 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cz89b\"" Jun 09 00:22:51.612114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.611881 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 00:22:51.612114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.612087 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 00:22:51.612291 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.612218 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-15bf886cu1fs\"" Jun 09 00:22:51.620066 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.620043 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-766675688d-4pfm9"] Jun 09 00:22:51.641838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.641814 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:51.688083 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.688062 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:22:51.752334 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-grpc-tls\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752451 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752451 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-tls\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752582 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752582 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b17661a4-180f-4a67-af55-f080ebbd98c9-metrics-client-ca\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752687 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752687 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.752779 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.752694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x949n\" (UniqueName: \"kubernetes.io/projected/b17661a4-180f-4a67-af55-f080ebbd98c9-kube-api-access-x949n\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.853659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-grpc-tls\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.853777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.853777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-tls\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.853873 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.853873 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b17661a4-180f-4a67-af55-f080ebbd98c9-metrics-client-ca\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.853873 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.854025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.854025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.853926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x949n\" (UniqueName: \"kubernetes.io/projected/b17661a4-180f-4a67-af55-f080ebbd98c9-kube-api-access-x949n\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.854641 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.854616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b17661a4-180f-4a67-af55-f080ebbd98c9-metrics-client-ca\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.856598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.856575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-tls\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.857344 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.857063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.857495 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.857473 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.857760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.857735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-grpc-tls\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.858405 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.858381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.858602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.858585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b17661a4-180f-4a67-af55-f080ebbd98c9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.861898 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.861877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x949n\" (UniqueName: \"kubernetes.io/projected/b17661a4-180f-4a67-af55-f080ebbd98c9-kube-api-access-x949n\") pod \"thanos-querier-766675688d-4pfm9\" (UID: \"b17661a4-180f-4a67-af55-f080ebbd98c9\") " pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.919071 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.919021 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:51.976681 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.976648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkch8" event={"ID":"3c1199d4-36c5-4883-a05f-4565d5d9df49","Type":"ContainerStarted","Data":"43f6bee7fab34314f27a5f2b7bd105af1e4c06a04e2bfbb3aac5d931a5530f82"} Jun 09 00:22:51.976805 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.976704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkch8" event={"ID":"3c1199d4-36c5-4883-a05f-4565d5d9df49","Type":"ContainerStarted","Data":"932a795deb8c00d8259af7c54d3379f7be433fb7c80397235adb45f36a5d0028"} Jun 09 00:22:51.982696 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.982671 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8" exitCode=0 Jun 09 00:22:51.982806 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.982728 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8"} Jun 09 00:22:51.995006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:51.994968 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kkch8" podStartSLOduration=3.065118037 podStartE2EDuration="3.994955134s" totalImagesPullingTime="857.398303ms" totalInitContainerRuntime="72.438794ms" isStatefulPod=true podCreationTimestamp="2026-06-09 00:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:51.99371241 +0000 UTC m=+184.041439846" watchObservedRunningTime="2026-06-09 00:22:51.994955134 +0000 UTC m=+184.042682569" Jun 09 00:22:52.026011 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:52.025987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:52.125822 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:52.125782 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:52.133801 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:52.133776 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-766675688d-4pfm9"] Jun 09 00:22:52.989471 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:52.989427 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" event={"ID":"e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac","Type":"ContainerStarted","Data":"016cad7b9b94348842ae570eebfba5fc0d4f01df9486b5a4b3689036486b22f2"} Jun 09 00:22:53.008932 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.008879 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fx6fb" podStartSLOduration=3.6956275 podStartE2EDuration="5.008862367s" totalImagesPullingTime="1.313234867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:53.008006341 +0000 UTC m=+185.055733776" watchObservedRunningTime="2026-06-09 00:22:53.008862367 +0000 UTC m=+185.056589802" Jun 09 00:22:53.083817 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:22:53.083793 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17661a4_180f_4a67_af55_f080ebbd98c9.slice/crio-93e5c241e627bb39037e3d1861ad2ab3e19d410c6c06522abc37807d8adcfd25 WatchSource:0}: Error finding container 93e5c241e627bb39037e3d1861ad2ab3e19d410c6c06522abc37807d8adcfd25: Status 404 returned error can't find the container with id 93e5c241e627bb39037e3d1861ad2ab3e19d410c6c06522abc37807d8adcfd25 Jun 09 00:22:53.257438 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.257322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:53.413095 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.412996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:53.506271 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.506243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:53.607281 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.607205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:53.996034 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.995969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdf7d6f78-cqrks" event={"ID":"67f14452-a99c-4945-9ea6-e900dc5a2801","Type":"ContainerStarted","Data":"209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860"} Jun 09 00:22:53.997505 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:53.997454 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"93e5c241e627bb39037e3d1861ad2ab3e19d410c6c06522abc37807d8adcfd25"} Jun 09 00:22:54.012168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.012122 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdf7d6f78-cqrks" podStartSLOduration=2.009048334 podStartE2EDuration="6.012101894s" totalImagesPullingTime="4.00305356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:54.011310665 +0000 UTC m=+186.059038102" watchObservedRunningTime="2026-06-09 00:22:54.012101894 +0000 UTC m=+186.059829330" Jun 09 00:22:54.148373 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.148329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:54.198023 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.197993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:54.282247 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.282176 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:54.344508 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.344484 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:54.444428 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.444395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:54.961277 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:54.961250 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:55.004291 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:55.004270 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9"} Jun 09 00:22:55.004618 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:55.004326 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8"} Jun 09 00:22:55.004618 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:55.004351 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811"} Jun 09 00:22:55.011657 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:55.011632 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"a4ab0679fd899c619bbe58bcb93ab5d4a3345e2c5643225eecad7550cc3a2453"} Jun 09 00:22:55.011754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:55.011701 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"0112dbe20afb60b370705213dfb73a602d97537a5f1035dfce44a64e2600652e"} Jun 09 00:22:55.011754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:55.011739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"657a4cce7a3dc1d3fe1ed58df49d75c905d1769b1de962c919994b54ebd49a5d"} Jun 09 00:22:56.019589 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.019542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"c1847ba521536eac1748b690c629b0134ce92f921999226d75cfda7e6e503f08"} Jun 09 00:22:56.019989 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.019657 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"513d764bed3bdc2922d37186da7d11df3fea380838372dfa609e4fec89b0c581"} Jun 09 00:22:56.019989 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.019694 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" event={"ID":"b17661a4-180f-4a67-af55-f080ebbd98c9","Type":"ContainerStarted","Data":"d787de2d7f9debd0f5475ac2229b19cd0f18e9dc38385188896556a1d5f7dc91"} Jun 09 00:22:56.019989 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.019738 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:22:56.023391 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.023363 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e"} Jun 09 00:22:56.023491 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.023439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089"} Jun 09 00:22:56.023491 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.023475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerStarted","Data":"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93"} Jun 09 00:22:56.041593 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.041515 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" podStartSLOduration=2.476262035 podStartE2EDuration="5.04149967s" totalImagesPullingTime="2.565237635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:56.039319881 +0000 UTC m=+188.087047316" watchObservedRunningTime="2026-06-09 00:22:56.04149967 +0000 UTC m=+188.089227106" Jun 09 00:22:56.062156 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:56.062089 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.959043142 podStartE2EDuration="7.062077888s" totalImagesPullingTime="4.085255688s" totalInitContainerRuntime="17.779058ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:22:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:22:56.060905555 +0000 UTC m=+188.108632990" watchObservedRunningTime="2026-06-09 00:22:56.062077888 +0000 UTC m=+188.109805347" Jun 09 00:22:58.856924 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:58.856887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:58.956840 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:58.956810 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:22:58.994658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:58.994631 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:58.994772 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:58.994687 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:58.998975 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:58.998954 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:22:59.038613 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:22:59.038593 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:23:00.126046 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:00.126013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:00.218274 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:00.218247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:02.034364 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:02.034340 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-766675688d-4pfm9" Jun 09 00:23:03.189259 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:03.189227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:03.282652 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:03.282611 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:03.933575 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:03.933529 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cd49848c-d4b45" Jun 09 00:23:04.048923 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:04.048895 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:04.149785 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:04.149751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:04.249695 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:04.249636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:04.349361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:04.349337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:04.400525 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:04.400503 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:06.699527 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:06.699480 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" podUID="c9319685-3f77-4798-94ca-f4594879a053" containerName="registry" containerID="cri-o://279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b" gracePeriod=30 Jun 09 00:23:06.951773 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:06.951718 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:23:07.068964 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.068933 2572 generic.go:356] "Generic (PLEG): container finished" podID="c9319685-3f77-4798-94ca-f4594879a053" containerID="279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b" exitCode=0 Jun 09 00:23:07.069064 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.068973 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" Jun 09 00:23:07.069064 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.068995 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" event={"ID":"c9319685-3f77-4798-94ca-f4594879a053","Type":"ContainerDied","Data":"279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b"} Jun 09 00:23:07.069064 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.069040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685f6b5867-hsk68" event={"ID":"c9319685-3f77-4798-94ca-f4594879a053","Type":"ContainerDied","Data":"ed2620c80b6c2fb8328295e74d0f44796838baed280e65b6d0a6eb0a33c22f09"} Jun 09 00:23:07.069171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.069069 2572 scope.go:117] "RemoveContainer" containerID="279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b" Jun 09 00:23:07.071206 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071186 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbfpq\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-kube-api-access-rbfpq\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071303 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071240 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-image-registry-private-configuration\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071303 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071262 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9319685-3f77-4798-94ca-f4594879a053-ca-trust-extracted\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071386 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071369 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-trusted-ca\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071424 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071406 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-bound-sa-token\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071465 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071433 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-installation-pull-secrets\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071495 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071486 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-registry-certificates\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.071567 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071533 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") pod \"c9319685-3f77-4798-94ca-f4594879a053\" (UID: \"c9319685-3f77-4798-94ca-f4594879a053\") " Jun 09 00:23:07.072298 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.071791 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:07.072851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.072403 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:07.073966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.073920 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:23:07.073966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.073942 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:23:07.074108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.073920 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-kube-api-access-rbfpq" (OuterVolumeSpecName: "kube-api-access-rbfpq") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "kube-api-access-rbfpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:07.074457 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.074426 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:07.074602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.074581 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:07.078090 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.078070 2572 scope.go:117] "RemoveContainer" containerID="279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b" Jun 09 00:23:07.078388 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:23:07.078364 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b\": container with ID starting with 279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b not found: ID does not exist" containerID="279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b" Jun 09 00:23:07.078453 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.078396 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b"} err="failed to get container status \"279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b\": rpc error: code = NotFound desc = could not find container \"279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b\": container with ID starting with 279d76e31f55e4267b93ce930922fac3aa8d0f00cfd16fb2cd06b447d46ccb6b not found: ID does not exist" Jun 09 00:23:07.079719 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.079695 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9319685-3f77-4798-94ca-f4594879a053-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c9319685-3f77-4798-94ca-f4594879a053" (UID: "c9319685-3f77-4798-94ca-f4594879a053"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:23:07.172364 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172340 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-bound-sa-token\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172364 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172362 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-installation-pull-secrets\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172377 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-registry-certificates\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172389 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-registry-tls\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172401 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbfpq\" (UniqueName: \"kubernetes.io/projected/c9319685-3f77-4798-94ca-f4594879a053-kube-api-access-rbfpq\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172415 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9319685-3f77-4798-94ca-f4594879a053-image-registry-private-configuration\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172427 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9319685-3f77-4798-94ca-f4594879a053-ca-trust-extracted\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.172482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.172440 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9319685-3f77-4798-94ca-f4594879a053-trusted-ca\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:07.390191 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.390167 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685f6b5867-hsk68"] Jun 09 00:23:07.398228 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:07.398208 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-685f6b5867-hsk68"] Jun 09 00:23:08.382635 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:08.382604 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9319685-3f77-4798-94ca-f4594879a053" path="/var/lib/kubelet/pods/c9319685-3f77-4798-94ca-f4594879a053/volumes" Jun 09 00:23:13.035619 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:13.035573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:13.084084 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:13.084053 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:14.193491 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:14.193460 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdf7d6f78-cqrks"] Jun 09 00:23:14.289373 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:14.289343 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:14.338333 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:14.338308 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:14.399052 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:14.399028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:27.146451 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:27.146418 2572 generic.go:356] "Generic (PLEG): container finished" podID="9783c1fb-6218-4a82-9596-4035a4663998" containerID="cbd13004b1809fbdbc4b9f1ec1cb557e78e01640f0fcbce9d28932eec959216e" exitCode=0 Jun 09 00:23:27.146853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:27.146455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" event={"ID":"9783c1fb-6218-4a82-9596-4035a4663998","Type":"ContainerDied","Data":"cbd13004b1809fbdbc4b9f1ec1cb557e78e01640f0fcbce9d28932eec959216e"} Jun 09 00:23:27.146853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:27.146757 2572 scope.go:117] "RemoveContainer" containerID="cbd13004b1809fbdbc4b9f1ec1cb557e78e01640f0fcbce9d28932eec959216e" Jun 09 00:23:28.038336 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:28.038292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:28.138037 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:28.138001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:23:28.153598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:28.153569 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-q4r8j" event={"ID":"9783c1fb-6218-4a82-9596-4035a4663998","Type":"ContainerStarted","Data":"c70d2030e90965503a53b9b8992a47492a6bfb74b215ef0f55a6f703ad06d6b9"} Jun 09 00:23:39.214262 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.214203 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fdf7d6f78-cqrks" podUID="67f14452-a99c-4945-9ea6-e900dc5a2801" containerName="console" containerID="cri-o://209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860" gracePeriod=15 Jun 09 00:23:39.456874 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.456849 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:23:39.506509 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506450 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-console-config\") pod \"67f14452-a99c-4945-9ea6-e900dc5a2801\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " Jun 09 00:23:39.506509 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506492 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-serving-cert\") pod \"67f14452-a99c-4945-9ea6-e900dc5a2801\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " Jun 09 00:23:39.506688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506523 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc65r\" (UniqueName: \"kubernetes.io/projected/67f14452-a99c-4945-9ea6-e900dc5a2801-kube-api-access-dc65r\") pod \"67f14452-a99c-4945-9ea6-e900dc5a2801\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " Jun 09 00:23:39.506688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506568 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-oauth-serving-cert\") pod \"67f14452-a99c-4945-9ea6-e900dc5a2801\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " Jun 09 00:23:39.506688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506621 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-service-ca\") pod \"67f14452-a99c-4945-9ea6-e900dc5a2801\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " Jun 09 00:23:39.506688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-oauth-config\") pod \"67f14452-a99c-4945-9ea6-e900dc5a2801\" (UID: \"67f14452-a99c-4945-9ea6-e900dc5a2801\") " Jun 09 00:23:39.506958 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506924 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-console-config" (OuterVolumeSpecName: "console-config") pod "67f14452-a99c-4945-9ea6-e900dc5a2801" (UID: "67f14452-a99c-4945-9ea6-e900dc5a2801"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:39.506958 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506941 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67f14452-a99c-4945-9ea6-e900dc5a2801" (UID: "67f14452-a99c-4945-9ea6-e900dc5a2801"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:39.507173 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.506985 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-service-ca" (OuterVolumeSpecName: "service-ca") pod "67f14452-a99c-4945-9ea6-e900dc5a2801" (UID: "67f14452-a99c-4945-9ea6-e900dc5a2801"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:23:39.508621 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.508595 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67f14452-a99c-4945-9ea6-e900dc5a2801" (UID: "67f14452-a99c-4945-9ea6-e900dc5a2801"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:23:39.508704 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.508676 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f14452-a99c-4945-9ea6-e900dc5a2801-kube-api-access-dc65r" (OuterVolumeSpecName: "kube-api-access-dc65r") pod "67f14452-a99c-4945-9ea6-e900dc5a2801" (UID: "67f14452-a99c-4945-9ea6-e900dc5a2801"). InnerVolumeSpecName "kube-api-access-dc65r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:23:39.508747 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.508713 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67f14452-a99c-4945-9ea6-e900dc5a2801" (UID: "67f14452-a99c-4945-9ea6-e900dc5a2801"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:23:39.608028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.608004 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-serving-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:39.608028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.608024 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc65r\" (UniqueName: \"kubernetes.io/projected/67f14452-a99c-4945-9ea6-e900dc5a2801-kube-api-access-dc65r\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:39.608140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.608032 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-oauth-serving-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:39.608140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.608042 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-service-ca\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:39.608140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.608052 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f14452-a99c-4945-9ea6-e900dc5a2801-console-oauth-config\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:39.608140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:39.608060 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f14452-a99c-4945-9ea6-e900dc5a2801-console-config\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:23:40.198912 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.198879 2572 generic.go:356] "Generic (PLEG): container finished" podID="67f14452-a99c-4945-9ea6-e900dc5a2801" containerID="209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860" exitCode=0 Jun 09 00:23:40.199048 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.198946 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdf7d6f78-cqrks" Jun 09 00:23:40.199048 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.198971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdf7d6f78-cqrks" event={"ID":"67f14452-a99c-4945-9ea6-e900dc5a2801","Type":"ContainerDied","Data":"209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860"} Jun 09 00:23:40.199048 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.199038 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdf7d6f78-cqrks" event={"ID":"67f14452-a99c-4945-9ea6-e900dc5a2801","Type":"ContainerDied","Data":"b26c9bb35e415b2f52dd4cb8668d4f1d8020aad812e5fbcf5712ce5f74976ad5"} Jun 09 00:23:40.199200 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.199063 2572 scope.go:117] "RemoveContainer" containerID="209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860" Jun 09 00:23:40.208202 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.208182 2572 scope.go:117] "RemoveContainer" containerID="209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860" Jun 09 00:23:40.208485 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:23:40.208462 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860\": container with ID starting with 209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860 not found: ID does not exist" containerID="209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860" Jun 09 00:23:40.208534 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.208491 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860"} err="failed to get container status \"209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860\": rpc error: code = NotFound desc = could not find container \"209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860\": container with ID starting with 209dad98330c60cf2537e29db3fc938413032d0ec4d7496fe40a468828f57860 not found: ID does not exist" Jun 09 00:23:40.218471 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.218445 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdf7d6f78-cqrks"] Jun 09 00:23:40.220422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.220393 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fdf7d6f78-cqrks"] Jun 09 00:23:40.382469 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:23:40.382440 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f14452-a99c-4945-9ea6-e900dc5a2801" path="/var/lib/kubelet/pods/67f14452-a99c-4945-9ea6-e900dc5a2801/volumes" Jun 09 00:24:00.256356 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:00.256261 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:24:00.258630 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:00.258605 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8681e4f-fd46-4459-a758-86bd8e59af0b-metrics-certs\") pod \"network-metrics-daemon-7gn4s\" (UID: \"b8681e4f-fd46-4459-a758-86bd8e59af0b\") " pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:24:00.380829 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:00.380794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f26v2\"" Jun 09 00:24:00.388738 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:00.388716 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gn4s" Jun 09 00:24:00.509496 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:00.509431 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gn4s"] Jun 09 00:24:00.512148 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:24:00.512123 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8681e4f_fd46_4459_a758_86bd8e59af0b.slice/crio-5c39d871b3c13b8b196b737d719f2358033100837d9b995d052bdcf79fe9131a WatchSource:0}: Error finding container 5c39d871b3c13b8b196b737d719f2358033100837d9b995d052bdcf79fe9131a: Status 404 returned error can't find the container with id 5c39d871b3c13b8b196b737d719f2358033100837d9b995d052bdcf79fe9131a Jun 09 00:24:01.276775 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:01.276739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gn4s" event={"ID":"b8681e4f-fd46-4459-a758-86bd8e59af0b","Type":"ContainerStarted","Data":"5c39d871b3c13b8b196b737d719f2358033100837d9b995d052bdcf79fe9131a"} Jun 09 00:24:01.417074 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:01.417042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:01.476059 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:01.476035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:02.282893 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:02.282848 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gn4s" event={"ID":"b8681e4f-fd46-4459-a758-86bd8e59af0b","Type":"ContainerStarted","Data":"42abfbea9c05104a1ce7b639d67feb8e7fe2e7a94cd8f70b267c7e282b3a629a"} Jun 09 00:24:02.283330 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:02.282920 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gn4s" event={"ID":"b8681e4f-fd46-4459-a758-86bd8e59af0b","Type":"ContainerStarted","Data":"f61a2e6876bee0a8d2254a599f3319f78ac04da550507fdde6a3d8bd7639a204"} Jun 09 00:24:02.297885 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:02.297803 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7gn4s" podStartSLOduration=253.500106877 podStartE2EDuration="4m14.297788344s" totalImagesPullingTime="797.681467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:24:02.296928775 +0000 UTC m=+254.344656210" watchObservedRunningTime="2026-06-09 00:24:02.297788344 +0000 UTC m=+254.345515779" Jun 09 00:24:02.383250 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:02.383218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:02.483922 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:02.483899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:04.719600 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:04.719549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:04.772866 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:04.772840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:06.708209 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:06.708174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:06.760882 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:06.760855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:09.019591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019536 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:24:09.019966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019841 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="alertmanager" containerID="cri-o://236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811" gracePeriod=120 Jun 09 00:24:09.019966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019912 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-metric" containerID="cri-o://c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089" gracePeriod=120 Jun 09 00:24:09.019966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019945 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="config-reloader" containerID="cri-o://fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8" gracePeriod=120 Jun 09 00:24:09.020183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019956 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="prom-label-proxy" containerID="cri-o://f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e" gracePeriod=120 Jun 09 00:24:09.020183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019980 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-web" containerID="cri-o://7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9" gracePeriod=120 Jun 09 00:24:09.020183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.019925 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy" containerID="cri-o://77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93" gracePeriod=120 Jun 09 00:24:09.321669 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321597 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e" exitCode=0 Jun 09 00:24:09.321669 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321623 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93" exitCode=0 Jun 09 00:24:09.321669 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321632 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8" exitCode=0 Jun 09 00:24:09.321669 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321640 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811" exitCode=0 Jun 09 00:24:09.321883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e"} Jun 09 00:24:09.321883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321729 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93"} Jun 09 00:24:09.321883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8"} Jun 09 00:24:09.321883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:09.321784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811"} Jun 09 00:24:10.260641 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.260619 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.329332 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.329303 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089"} Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.329231 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089" exitCode=0 Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.329659 2572 generic.go:356] "Generic (PLEG): container finished" podID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerID="7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9" exitCode=0 Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.329679 2572 scope.go:117] "RemoveContainer" containerID="f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e" Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.329726 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.329756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9"} Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.330550 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da80922c-d2ad-4c47-be3b-758eb677fd0e","Type":"ContainerDied","Data":"2f71f8b0722d1ac33a23dc253af2c3423fd26cff4072905a30c9e20712548322"} Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.330885 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-main-db\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.330951 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpj68\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-kube-api-access-gpj68\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.330985 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331033 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-metrics-client-ca\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331057 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-web\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331088 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-cluster-tls-config\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331126 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-web-config\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331157 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-main-tls\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331185 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-trusted-ca-bundle\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331234 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-volume\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331265 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331303 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-out\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.331334 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-tls-assets\") pod \"da80922c-d2ad-4c47-be3b-758eb677fd0e\" (UID: \"da80922c-d2ad-4c47-be3b-758eb677fd0e\") " Jun 09 00:24:10.332984 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.332523 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:24:10.335591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.335544 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:24:10.335937 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.335911 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:24:10.336430 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.336402 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-kube-api-access-gpj68" (OuterVolumeSpecName: "kube-api-access-gpj68") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "kube-api-access-gpj68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:24:10.336505 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.336482 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:24:10.338110 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.338068 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.338622 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.338532 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-volume" (OuterVolumeSpecName: "config-volume") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.339036 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.339006 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.339200 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.339182 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.340019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.339987 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-out" (OuterVolumeSpecName: "config-out") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:24:10.340773 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.340748 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.342804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.342783 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.345216 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.345197 2572 scope.go:117] "RemoveContainer" containerID="c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089" Jun 09 00:24:10.348280 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.348260 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-web-config" (OuterVolumeSpecName: "web-config") pod "da80922c-d2ad-4c47-be3b-758eb677fd0e" (UID: "da80922c-d2ad-4c47-be3b-758eb677fd0e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:24:10.351501 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.351486 2572 scope.go:117] "RemoveContainer" containerID="77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93" Jun 09 00:24:10.357387 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.357370 2572 scope.go:117] "RemoveContainer" containerID="7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9" Jun 09 00:24:10.363294 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.363277 2572 scope.go:117] "RemoveContainer" containerID="fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8" Jun 09 00:24:10.369304 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.369287 2572 scope.go:117] "RemoveContainer" containerID="236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811" Jun 09 00:24:10.375488 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.375469 2572 scope.go:117] "RemoveContainer" containerID="b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8" Jun 09 00:24:10.381809 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.381796 2572 scope.go:117] "RemoveContainer" containerID="f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e" Jun 09 00:24:10.382003 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.381988 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e\": container with ID starting with f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e not found: ID does not exist" containerID="f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e" Jun 09 00:24:10.382048 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382012 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e"} err="failed to get container status \"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e\": rpc error: code = NotFound desc = could not find container \"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e\": container with ID starting with f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e not found: ID does not exist" Jun 09 00:24:10.382048 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382028 2572 scope.go:117] "RemoveContainer" containerID="c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089" Jun 09 00:24:10.382268 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.382252 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089\": container with ID starting with c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089 not found: ID does not exist" containerID="c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089" Jun 09 00:24:10.382311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382273 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089"} err="failed to get container status \"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089\": rpc error: code = NotFound desc = could not find container \"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089\": container with ID starting with c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089 not found: ID does not exist" Jun 09 00:24:10.382311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382289 2572 scope.go:117] "RemoveContainer" containerID="77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93" Jun 09 00:24:10.382539 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.382524 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93\": container with ID starting with 77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93 not found: ID does not exist" containerID="77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93" Jun 09 00:24:10.382603 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382541 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93"} err="failed to get container status \"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93\": rpc error: code = NotFound desc = could not find container \"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93\": container with ID starting with 77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93 not found: ID does not exist" Jun 09 00:24:10.382603 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382568 2572 scope.go:117] "RemoveContainer" containerID="7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9" Jun 09 00:24:10.382785 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.382769 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9\": container with ID starting with 7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9 not found: ID does not exist" containerID="7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9" Jun 09 00:24:10.382821 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382791 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9"} err="failed to get container status \"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9\": rpc error: code = NotFound desc = could not find container \"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9\": container with ID starting with 7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9 not found: ID does not exist" Jun 09 00:24:10.382821 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.382805 2572 scope.go:117] "RemoveContainer" containerID="fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8" Jun 09 00:24:10.383029 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.383014 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8\": container with ID starting with fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8 not found: ID does not exist" containerID="fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8" Jun 09 00:24:10.383081 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383031 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8"} err="failed to get container status \"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8\": rpc error: code = NotFound desc = could not find container \"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8\": container with ID starting with fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8 not found: ID does not exist" Jun 09 00:24:10.383081 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383042 2572 scope.go:117] "RemoveContainer" containerID="236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811" Jun 09 00:24:10.383253 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.383238 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811\": container with ID starting with 236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811 not found: ID does not exist" containerID="236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811" Jun 09 00:24:10.383289 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383257 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811"} err="failed to get container status \"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811\": rpc error: code = NotFound desc = could not find container \"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811\": container with ID starting with 236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811 not found: ID does not exist" Jun 09 00:24:10.383289 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383270 2572 scope.go:117] "RemoveContainer" containerID="b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8" Jun 09 00:24:10.383443 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:24:10.383429 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8\": container with ID starting with b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8 not found: ID does not exist" containerID="b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8" Jun 09 00:24:10.383483 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383445 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8"} err="failed to get container status \"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8\": rpc error: code = NotFound desc = could not find container \"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8\": container with ID starting with b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8 not found: ID does not exist" Jun 09 00:24:10.383483 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383455 2572 scope.go:117] "RemoveContainer" containerID="f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e" Jun 09 00:24:10.383691 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383673 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e"} err="failed to get container status \"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e\": rpc error: code = NotFound desc = could not find container \"f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e\": container with ID starting with f6800c436de9eb20d6d017d5591662b39c352f415fe61ab5f5fe88397587410e not found: ID does not exist" Jun 09 00:24:10.383740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383690 2572 scope.go:117] "RemoveContainer" containerID="c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089" Jun 09 00:24:10.383924 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383909 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089"} err="failed to get container status \"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089\": rpc error: code = NotFound desc = could not find container \"c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089\": container with ID starting with c6fc94603c4c544de82978ed0992f1fc09be6d67afd953d831851baefae4c089 not found: ID does not exist" Jun 09 00:24:10.383924 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.383924 2572 scope.go:117] "RemoveContainer" containerID="77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93" Jun 09 00:24:10.384122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384102 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93"} err="failed to get container status \"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93\": rpc error: code = NotFound desc = could not find container \"77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93\": container with ID starting with 77c4ab2897904ee9e1c5e60e586d95f3eb3d2068bd9e19dc6789376da0a6af93 not found: ID does not exist" Jun 09 00:24:10.384122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384117 2572 scope.go:117] "RemoveContainer" containerID="7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9" Jun 09 00:24:10.384309 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384293 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9"} err="failed to get container status \"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9\": rpc error: code = NotFound desc = could not find container \"7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9\": container with ID starting with 7cafacae2863949abb8438d6df3de3fce7cbc941e7ea41165db08ef99abb79b9 not found: ID does not exist" Jun 09 00:24:10.384360 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384309 2572 scope.go:117] "RemoveContainer" containerID="fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8" Jun 09 00:24:10.384513 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384496 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8"} err="failed to get container status \"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8\": rpc error: code = NotFound desc = could not find container \"fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8\": container with ID starting with fb247d424504aaabbefae196dc3df936d731637040e2353b21b50ec7df3dd2c8 not found: ID does not exist" Jun 09 00:24:10.384636 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384513 2572 scope.go:117] "RemoveContainer" containerID="236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811" Jun 09 00:24:10.384763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384749 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811"} err="failed to get container status \"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811\": rpc error: code = NotFound desc = could not find container \"236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811\": container with ID starting with 236f998669f333eaa65ba3acd9eb53f423db804f80cd3962c86615bfa1d5e811 not found: ID does not exist" Jun 09 00:24:10.384803 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384763 2572 scope.go:117] "RemoveContainer" containerID="b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8" Jun 09 00:24:10.384972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.384958 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8"} err="failed to get container status \"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8\": rpc error: code = NotFound desc = could not find container \"b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8\": container with ID starting with b319df36ca05736d59e1e8eb8dc2ecebfab23fceb4e9ab896867efa7a47245b8 not found: ID does not exist" Jun 09 00:24:10.432240 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432222 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432240 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432241 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-volume\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432250 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432260 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-config-out\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432268 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-tls-assets\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432275 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da80922c-d2ad-4c47-be3b-758eb677fd0e-alertmanager-main-db\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432283 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpj68\" (UniqueName: \"kubernetes.io/projected/da80922c-d2ad-4c47-be3b-758eb677fd0e-kube-api-access-gpj68\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432292 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432299 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da80922c-d2ad-4c47-be3b-758eb677fd0e-metrics-client-ca\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432307 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432315 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-cluster-tls-config\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432322 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-web-config\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.432348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.432330 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da80922c-d2ad-4c47-be3b-758eb677fd0e-secret-alertmanager-main-tls\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:24:10.648374 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.648347 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:24:10.652843 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.652817 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:24:10.677257 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677236 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:24:10.677481 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677469 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy" Jun 09 00:24:10.677481 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677482 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677491 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f14452-a99c-4945-9ea6-e900dc5a2801" containerName="console" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677496 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f14452-a99c-4945-9ea6-e900dc5a2801" containerName="console" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677510 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="alertmanager" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677516 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="alertmanager" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677522 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="init-config-reloader" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677527 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="init-config-reloader" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677533 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-metric" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677538 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-metric" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677547 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="config-reloader" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677567 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="config-reloader" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677573 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-web" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677578 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-web" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677586 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9319685-3f77-4798-94ca-f4594879a053" containerName="registry" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677592 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9319685-3f77-4798-94ca-f4594879a053" containerName="registry" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677599 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="prom-label-proxy" Jun 09 00:24:10.677598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677606 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="prom-label-proxy" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677652 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-metric" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677665 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="config-reloader" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677674 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="alertmanager" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677680 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy-web" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677685 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9319685-3f77-4798-94ca-f4594879a053" containerName="registry" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677691 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="67f14452-a99c-4945-9ea6-e900dc5a2801" containerName="console" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677696 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="prom-label-proxy" Jun 09 00:24:10.678063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.677702 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" containerName="kube-rbac-proxy" Jun 09 00:24:10.680930 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.680916 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.683196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683164 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 00:24:10.683196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683177 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r5m2j\"" Jun 09 00:24:10.683361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683196 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 00:24:10.683361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683221 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 00:24:10.683361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683267 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 00:24:10.683361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683277 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 00:24:10.683361 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683177 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 00:24:10.683590 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 00:24:10.683590 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.683529 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 00:24:10.688779 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.688760 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 00:24:10.693085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.693064 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:24:10.834877 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.834852 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.834982 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.834880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41cdd27-64be-4cfa-934d-9debecfe42b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.834982 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.834908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.834982 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.834924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-web-config\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.834982 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.834964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcchs\" (UniqueName: \"kubernetes.io/projected/e41cdd27-64be-4cfa-934d-9debecfe42b0-kube-api-access-fcchs\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835137 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835137 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835197 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e41cdd27-64be-4cfa-934d-9debecfe42b0-config-out\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835197 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41cdd27-64be-4cfa-934d-9debecfe42b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e41cdd27-64be-4cfa-934d-9debecfe42b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.835387 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.835292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e41cdd27-64be-4cfa-934d-9debecfe42b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.935881 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.935824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e41cdd27-64be-4cfa-934d-9debecfe42b0-config-out\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.935881 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.935855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41cdd27-64be-4cfa-934d-9debecfe42b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.935881 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.935876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.935893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e41cdd27-64be-4cfa-934d-9debecfe42b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.935936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936028 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.935975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e41cdd27-64be-4cfa-934d-9debecfe42b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936148 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936193 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41cdd27-64be-4cfa-934d-9debecfe42b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936256 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-web-config\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcchs\" (UniqueName: \"kubernetes.io/projected/e41cdd27-64be-4cfa-934d-9debecfe42b0-kube-api-access-fcchs\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936406 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936406 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.936497 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e41cdd27-64be-4cfa-934d-9debecfe42b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.937128 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.936820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41cdd27-64be-4cfa-934d-9debecfe42b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.938723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e41cdd27-64be-4cfa-934d-9debecfe42b0-config-out\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.938902 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e41cdd27-64be-4cfa-934d-9debecfe42b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939347 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939327 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939541 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939511 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939670 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939650 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939738 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939671 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-web-config\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.939854 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.939832 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41cdd27-64be-4cfa-934d-9debecfe42b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.940754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.940726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e41cdd27-64be-4cfa-934d-9debecfe42b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.943729 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.943707 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcchs\" (UniqueName: \"kubernetes.io/projected/e41cdd27-64be-4cfa-934d-9debecfe42b0-kube-api-access-fcchs\") pod \"alertmanager-main-0\" (UID: \"e41cdd27-64be-4cfa-934d-9debecfe42b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:10.990205 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:10.990185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 00:24:11.120327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:11.120297 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 00:24:11.123132 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:24:11.123108 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41cdd27_64be_4cfa_934d_9debecfe42b0.slice/crio-02848b4bde6fba4488ad1cf4213cb6ce421635341948bb66554d33482a61530c WatchSource:0}: Error finding container 02848b4bde6fba4488ad1cf4213cb6ce421635341948bb66554d33482a61530c: Status 404 returned error can't find the container with id 02848b4bde6fba4488ad1cf4213cb6ce421635341948bb66554d33482a61530c Jun 09 00:24:11.335914 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:11.335883 2572 generic.go:356] "Generic (PLEG): container finished" podID="e41cdd27-64be-4cfa-934d-9debecfe42b0" containerID="069e0abd5097dbdf8bb2f5953c1ecc7e3c7f895d7a03d1dfb8b3356a03c8b4bc" exitCode=0 Jun 09 00:24:11.336188 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:11.335939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerDied","Data":"069e0abd5097dbdf8bb2f5953c1ecc7e3c7f895d7a03d1dfb8b3356a03c8b4bc"} Jun 09 00:24:11.336188 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:11.336006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"02848b4bde6fba4488ad1cf4213cb6ce421635341948bb66554d33482a61530c"} Jun 09 00:24:12.346866 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.346819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"7dfd8a795231beeb186265da5ff8491985df449182563408e6faf70bb56b3932"} Jun 09 00:24:12.347224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.346942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"fa72380762f0a6b0a03d32d9d87815dd24fe56b1f3742a6c8ffc55e2de89b672"} Jun 09 00:24:12.347224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.347018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"8be5066170f27b0fab16e3ba487eb89150a65d51eabd9dc81488ef2817b5e164"} Jun 09 00:24:12.347224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.347058 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"445dfa99044c0cd01737902e83f5114fb4b40f4fdc2770f0b9415a7edc3464cd"} Jun 09 00:24:12.347224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.347097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"ae44dbb536a45daba6d515c728b3d1eb77592d78e7da17368121bf1a7216a579"} Jun 09 00:24:12.347224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.347134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e41cdd27-64be-4cfa-934d-9debecfe42b0","Type":"ContainerStarted","Data":"05dcdafc7dad70cf42979d685ecf4921006b621219fb2cf658ac77e5d47db883"} Jun 09 00:24:12.372386 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.372272 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.354751612 podStartE2EDuration="2.372254005s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.502393ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:24:12.370471159 +0000 UTC m=+264.418198594" watchObservedRunningTime="2026-06-09 00:24:12.372254005 +0000 UTC m=+264.419981443" Jun 09 00:24:12.382756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:12.382730 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da80922c-d2ad-4c47-be3b-758eb677fd0e" path="/var/lib/kubelet/pods/da80922c-d2ad-4c47-be3b-758eb677fd0e/volumes" Jun 09 00:24:16.596770 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:16.596739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:16.642295 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:16.642262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:23.702905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.702876 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585995749-dn4rx"] Jun 09 00:24:23.707531 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.707511 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.713930 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.713902 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 00:24:23.714113 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.714091 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 00:24:23.715206 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.715183 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 00:24:23.715315 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.715235 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 00:24:23.715908 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.715887 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ltrfd\"" Jun 09 00:24:23.716715 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.716026 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 00:24:23.716715 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.716173 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 00:24:23.716715 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.716596 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 00:24:23.719438 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.719416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585995749-dn4rx"] Jun 09 00:24:23.722945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.722922 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 00:24:23.772825 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.772804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:23.827019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.826995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-trusted-ca-bundle\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.827108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.827029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-serving-cert\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.827108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.827063 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpkf\" (UniqueName: \"kubernetes.io/projected/46893d8a-32ba-4c3e-806f-17764f5f04bf-kube-api-access-qvpkf\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.827174 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.827124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-oauth-config\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.827174 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.827163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-service-ca\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.827234 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.827180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-config\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.827234 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.827203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-oauth-serving-cert\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.899891 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.899863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:23.927904 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.927882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-oauth-config\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.927962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.927914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-service-ca\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.927962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.927930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-config\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.927962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.927952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-oauth-serving-cert\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.928067 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.927986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-trusted-ca-bundle\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.928067 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.928019 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-serving-cert\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.928067 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.928060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpkf\" (UniqueName: \"kubernetes.io/projected/46893d8a-32ba-4c3e-806f-17764f5f04bf-kube-api-access-qvpkf\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.928776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.928751 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-service-ca\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.928952 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.928800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-oauth-serving-cert\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.928952 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.928840 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-config\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.929109 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.929014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-trusted-ca-bundle\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.930562 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.930525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-oauth-config\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.930828 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.930807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-serving-cert\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.936017 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.935997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpkf\" (UniqueName: \"kubernetes.io/projected/46893d8a-32ba-4c3e-806f-17764f5f04bf-kube-api-access-qvpkf\") pod \"console-585995749-dn4rx\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:23.949962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:23.949939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:24.024511 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.024461 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:24.149266 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.149240 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585995749-dn4rx"] Jun 09 00:24:24.151944 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:24:24.151923 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46893d8a_32ba_4c3e_806f_17764f5f04bf.slice/crio-858a253e9fa69f98e50b2ca21623710f51aa0ed8e50129c88b1586c1519f961d WatchSource:0}: Error finding container 858a253e9fa69f98e50b2ca21623710f51aa0ed8e50129c88b1586c1519f961d: Status 404 returned error can't find the container with id 858a253e9fa69f98e50b2ca21623710f51aa0ed8e50129c88b1586c1519f961d Jun 09 00:24:24.395299 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.395266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585995749-dn4rx" event={"ID":"46893d8a-32ba-4c3e-806f-17764f5f04bf","Type":"ContainerStarted","Data":"568d0b2731291f4ceac4549966c2171c6b757108d92e4f3c1bcd649d49c525c6"} Jun 09 00:24:24.395435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.395313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585995749-dn4rx" event={"ID":"46893d8a-32ba-4c3e-806f-17764f5f04bf","Type":"ContainerStarted","Data":"858a253e9fa69f98e50b2ca21623710f51aa0ed8e50129c88b1586c1519f961d"} Jun 09 00:24:24.411541 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.411497 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585995749-dn4rx" podStartSLOduration=1.411478592 podStartE2EDuration="1.411478592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:24:24.410178462 +0000 UTC m=+276.457905900" watchObservedRunningTime="2026-06-09 00:24:24.411478592 +0000 UTC m=+276.459206027" Jun 09 00:24:24.496321 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.496292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:24.597795 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:24.597766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:28.042459 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:28.042423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:28.140636 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:28.140605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:28.192625 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:28.192603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:30.936541 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:30.936505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:34.024743 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.024710 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:34.025095 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.024808 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:34.028905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.028885 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:34.435769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.435748 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:24:34.587808 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.587783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:34.636975 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.636950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:34.691835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:34.691778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:37.631244 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:37.631205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:37.920167 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:37.920130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:45.963893 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:45.963863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:46.059591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.059533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:24:46.463569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.463528 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z"] Jun 09 00:24:46.468725 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.468703 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.470993 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.470967 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hm274\"" Jun 09 00:24:46.470993 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.470989 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:24:46.471147 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.470997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:24:46.475118 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.475086 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z"] Jun 09 00:24:46.585231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.585203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.585367 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.585238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.585367 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.585269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96fff\" (UniqueName: \"kubernetes.io/projected/285e2f68-6bea-4e93-b796-7701d254a455-kube-api-access-96fff\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.685756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.685724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.685882 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.685773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.685882 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.685823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96fff\" (UniqueName: \"kubernetes.io/projected/285e2f68-6bea-4e93-b796-7701d254a455-kube-api-access-96fff\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.686163 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.686137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.686233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.686147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.693568 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.693532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96fff\" (UniqueName: \"kubernetes.io/projected/285e2f68-6bea-4e93-b796-7701d254a455-kube-api-access-96fff\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.780707 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.780648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:24:46.915801 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:46.915778 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z"] Jun 09 00:24:46.918223 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:24:46.918198 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285e2f68_6bea_4e93_b796_7701d254a455.slice/crio-d553ac4f7e57ab075ece7644fc6660dfb1e614a85a439c38018a559dc57c596c WatchSource:0}: Error finding container d553ac4f7e57ab075ece7644fc6660dfb1e614a85a439c38018a559dc57c596c: Status 404 returned error can't find the container with id d553ac4f7e57ab075ece7644fc6660dfb1e614a85a439c38018a559dc57c596c Jun 09 00:24:47.491842 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:47.491807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" event={"ID":"285e2f68-6bea-4e93-b796-7701d254a455","Type":"ContainerStarted","Data":"d553ac4f7e57ab075ece7644fc6660dfb1e614a85a439c38018a559dc57c596c"} Jun 09 00:24:48.329767 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:48.329738 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:24:48.330492 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:48.330470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:24:48.334088 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:48.334066 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:24:48.335087 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:48.335070 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:24:48.340519 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:48.340503 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 00:24:52.512517 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:52.512455 2572 generic.go:356] "Generic (PLEG): container finished" podID="285e2f68-6bea-4e93-b796-7701d254a455" containerID="07414733cc30db899cd7356b9951dc52bd41dea4159999a55975d72158c2d344" exitCode=0 Jun 09 00:24:52.512517 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:52.512495 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" event={"ID":"285e2f68-6bea-4e93-b796-7701d254a455","Type":"ContainerDied","Data":"07414733cc30db899cd7356b9951dc52bd41dea4159999a55975d72158c2d344"} Jun 09 00:24:52.513439 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:52.513424 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:24:53.518064 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:53.518039 2572 generic.go:356] "Generic (PLEG): container finished" podID="285e2f68-6bea-4e93-b796-7701d254a455" containerID="ac41e233ace75bb7e16d081352ffe32f681f31bbaa42124465a1cb9df9536e88" exitCode=0 Jun 09 00:24:53.518340 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:24:53.518102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" event={"ID":"285e2f68-6bea-4e93-b796-7701d254a455","Type":"ContainerDied","Data":"ac41e233ace75bb7e16d081352ffe32f681f31bbaa42124465a1cb9df9536e88"} Jun 09 00:25:02.556439 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:02.556404 2572 generic.go:356] "Generic (PLEG): container finished" podID="285e2f68-6bea-4e93-b796-7701d254a455" containerID="dda56232569d5a758861c284f7f4d16eb1f45d01b7228970aaa9fd3e78d28228" exitCode=0 Jun 09 00:25:02.556866 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:02.556473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" event={"ID":"285e2f68-6bea-4e93-b796-7701d254a455","Type":"ContainerDied","Data":"dda56232569d5a758861c284f7f4d16eb1f45d01b7228970aaa9fd3e78d28228"} Jun 09 00:25:03.678887 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.678863 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:25:03.706999 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.706977 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96fff\" (UniqueName: \"kubernetes.io/projected/285e2f68-6bea-4e93-b796-7701d254a455-kube-api-access-96fff\") pod \"285e2f68-6bea-4e93-b796-7701d254a455\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " Jun 09 00:25:03.707089 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.707006 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-bundle\") pod \"285e2f68-6bea-4e93-b796-7701d254a455\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " Jun 09 00:25:03.707089 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.707054 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-util\") pod \"285e2f68-6bea-4e93-b796-7701d254a455\" (UID: \"285e2f68-6bea-4e93-b796-7701d254a455\") " Jun 09 00:25:03.707640 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.707619 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-bundle" (OuterVolumeSpecName: "bundle") pod "285e2f68-6bea-4e93-b796-7701d254a455" (UID: "285e2f68-6bea-4e93-b796-7701d254a455"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:25:03.709114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.709090 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285e2f68-6bea-4e93-b796-7701d254a455-kube-api-access-96fff" (OuterVolumeSpecName: "kube-api-access-96fff") pod "285e2f68-6bea-4e93-b796-7701d254a455" (UID: "285e2f68-6bea-4e93-b796-7701d254a455"). InnerVolumeSpecName "kube-api-access-96fff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:25:03.713208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.713183 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-util" (OuterVolumeSpecName: "util") pod "285e2f68-6bea-4e93-b796-7701d254a455" (UID: "285e2f68-6bea-4e93-b796-7701d254a455"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:25:03.808475 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.808456 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-util\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:25:03.808475 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.808474 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96fff\" (UniqueName: \"kubernetes.io/projected/285e2f68-6bea-4e93-b796-7701d254a455-kube-api-access-96fff\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:25:03.808612 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:03.808483 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285e2f68-6bea-4e93-b796-7701d254a455-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:25:04.565845 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:04.565818 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" Jun 09 00:25:04.565970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:04.565830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcf87z" event={"ID":"285e2f68-6bea-4e93-b796-7701d254a455","Type":"ContainerDied","Data":"d553ac4f7e57ab075ece7644fc6660dfb1e614a85a439c38018a559dc57c596c"} Jun 09 00:25:04.565970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:04.565951 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d553ac4f7e57ab075ece7644fc6660dfb1e614a85a439c38018a559dc57c596c" Jun 09 00:25:07.213777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:07.213740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:08.632699 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:08.632673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:10.825712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:10.825678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:10.921545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:10.921514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:12.954719 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:12.954682 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:13.055144 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:13.055107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:15.664806 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.664767 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9"] Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665079 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="extract" Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665090 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="extract" Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665109 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="util" Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665115 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="util" Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665125 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="pull" Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665130 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="pull" Jun 09 00:25:15.665230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.665180 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="285e2f68-6bea-4e93-b796-7701d254a455" containerName="extract" Jun 09 00:25:15.668093 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.668072 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.670208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.670183 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 00:25:15.670366 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.670345 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tmmhd\"" Jun 09 00:25:15.671150 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.671130 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 00:25:15.677286 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.677261 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9"] Jun 09 00:25:15.689784 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.689750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a92e641-3898-4f8f-89d9-63d7501d9af8-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-tf8r9\" (UID: \"2a92e641-3898-4f8f-89d9-63d7501d9af8\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.689892 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.689809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwtw\" (UniqueName: \"kubernetes.io/projected/2a92e641-3898-4f8f-89d9-63d7501d9af8-kube-api-access-knwtw\") pod \"cert-manager-webhook-7dc76cbb94-tf8r9\" (UID: \"2a92e641-3898-4f8f-89d9-63d7501d9af8\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.790249 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.790225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a92e641-3898-4f8f-89d9-63d7501d9af8-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-tf8r9\" (UID: \"2a92e641-3898-4f8f-89d9-63d7501d9af8\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.790357 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.790259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwtw\" (UniqueName: \"kubernetes.io/projected/2a92e641-3898-4f8f-89d9-63d7501d9af8-kube-api-access-knwtw\") pod \"cert-manager-webhook-7dc76cbb94-tf8r9\" (UID: \"2a92e641-3898-4f8f-89d9-63d7501d9af8\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.798401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.798367 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a92e641-3898-4f8f-89d9-63d7501d9af8-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-tf8r9\" (UID: \"2a92e641-3898-4f8f-89d9-63d7501d9af8\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.798708 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.798686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwtw\" (UniqueName: \"kubernetes.io/projected/2a92e641-3898-4f8f-89d9-63d7501d9af8-kube-api-access-knwtw\") pod \"cert-manager-webhook-7dc76cbb94-tf8r9\" (UID: \"2a92e641-3898-4f8f-89d9-63d7501d9af8\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:15.977196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:15.977125 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:16.107773 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:16.107741 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9"] Jun 09 00:25:16.109748 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:25:16.109727 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a92e641_3898_4f8f_89d9_63d7501d9af8.slice/crio-d44ca5e89506e7ae5774d2da9959b4b33dfc1c3dce9c7e4ce02355ac4e7189fb WatchSource:0}: Error finding container d44ca5e89506e7ae5774d2da9959b4b33dfc1c3dce9c7e4ce02355ac4e7189fb: Status 404 returned error can't find the container with id d44ca5e89506e7ae5774d2da9959b4b33dfc1c3dce9c7e4ce02355ac4e7189fb Jun 09 00:25:16.416122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:16.416098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:16.614741 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:16.614705 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" event={"ID":"2a92e641-3898-4f8f-89d9-63d7501d9af8","Type":"ContainerStarted","Data":"d44ca5e89506e7ae5774d2da9959b4b33dfc1c3dce9c7e4ce02355ac4e7189fb"} Jun 09 00:25:16.806185 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:16.806128 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:18.413231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:18.413200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:18.514411 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:18.514386 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:18.623978 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:18.623952 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" event={"ID":"2a92e641-3898-4f8f-89d9-63d7501d9af8","Type":"ContainerStarted","Data":"bc0bfe05ea97b96ad08020db8eedb297b65df1352f82a97ae866835d70855d8f"} Jun 09 00:25:18.624152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:18.624066 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:18.639097 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:18.639061 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" podStartSLOduration=1.351938979 podStartE2EDuration="3.639048861s" totalImagesPullingTime="2.287109882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:25:18.638417122 +0000 UTC m=+330.686144558" watchObservedRunningTime="2026-06-09 00:25:18.639048861 +0000 UTC m=+330.686776296" Jun 09 00:25:21.003008 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.002973 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5"] Jun 09 00:25:21.005344 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.005326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.008982 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.008951 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6469z\"" Jun 09 00:25:21.015343 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.015317 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5"] Jun 09 00:25:21.026676 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.026653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsr4f\" (UniqueName: \"kubernetes.io/projected/45780c5b-e7ed-4775-9c79-2d2cc1ba9339-kube-api-access-gsr4f\") pod \"cert-manager-cainjector-5d99449ffd-kg7m5\" (UID: \"45780c5b-e7ed-4775-9c79-2d2cc1ba9339\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.026772 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.026692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45780c5b-e7ed-4775-9c79-2d2cc1ba9339-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kg7m5\" (UID: \"45780c5b-e7ed-4775-9c79-2d2cc1ba9339\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.127459 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.127425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsr4f\" (UniqueName: \"kubernetes.io/projected/45780c5b-e7ed-4775-9c79-2d2cc1ba9339-kube-api-access-gsr4f\") pod \"cert-manager-cainjector-5d99449ffd-kg7m5\" (UID: \"45780c5b-e7ed-4775-9c79-2d2cc1ba9339\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.127601 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.127469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45780c5b-e7ed-4775-9c79-2d2cc1ba9339-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kg7m5\" (UID: \"45780c5b-e7ed-4775-9c79-2d2cc1ba9339\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.136388 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.136365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45780c5b-e7ed-4775-9c79-2d2cc1ba9339-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kg7m5\" (UID: \"45780c5b-e7ed-4775-9c79-2d2cc1ba9339\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.138410 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.138385 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsr4f\" (UniqueName: \"kubernetes.io/projected/45780c5b-e7ed-4775-9c79-2d2cc1ba9339-kube-api-access-gsr4f\") pod \"cert-manager-cainjector-5d99449ffd-kg7m5\" (UID: \"45780c5b-e7ed-4775-9c79-2d2cc1ba9339\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.314963 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.314909 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" Jun 09 00:25:21.441966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.441941 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5"] Jun 09 00:25:21.445396 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:25:21.445368 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45780c5b_e7ed_4775_9c79_2d2cc1ba9339.slice/crio-54fc87da38ffdf07ab63e7f164851d8d0c51e7d6a0838258cd0bdfef452aed98 WatchSource:0}: Error finding container 54fc87da38ffdf07ab63e7f164851d8d0c51e7d6a0838258cd0bdfef452aed98: Status 404 returned error can't find the container with id 54fc87da38ffdf07ab63e7f164851d8d0c51e7d6a0838258cd0bdfef452aed98 Jun 09 00:25:21.642821 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.642791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" event={"ID":"45780c5b-e7ed-4775-9c79-2d2cc1ba9339","Type":"ContainerStarted","Data":"a8b4178f44893676dfbfcef7f49335119503248d1fbeb393549277f5eaa01e70"} Jun 09 00:25:21.642951 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.642825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" event={"ID":"45780c5b-e7ed-4775-9c79-2d2cc1ba9339","Type":"ContainerStarted","Data":"54fc87da38ffdf07ab63e7f164851d8d0c51e7d6a0838258cd0bdfef452aed98"} Jun 09 00:25:21.658348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:21.658307 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kg7m5" podStartSLOduration=1.658292698 podStartE2EDuration="1.658292698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:25:21.657177735 +0000 UTC m=+333.704905170" watchObservedRunningTime="2026-06-09 00:25:21.658292698 +0000 UTC m=+333.706020133" Jun 09 00:25:22.632078 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:22.632049 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:22.684722 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:22.684702 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:24.011936 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:24.011905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:24.630380 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:24.630353 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-tf8r9" Jun 09 00:25:42.033619 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:42.033585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:42.123388 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:42.123353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:49.318388 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:49.318353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:49.421727 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:49.421696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:51.405564 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.405514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:51.891770 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.891742 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz"] Jun 09 00:25:51.895132 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.895117 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:51.897312 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.897290 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 00:25:51.898776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.898407 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 00:25:51.898776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.898535 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hm274\"" Jun 09 00:25:51.903378 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.903354 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz"] Jun 09 00:25:51.947431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.947408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jwwr\" (UniqueName: \"kubernetes.io/projected/b9a14119-8e68-4e71-bbcc-7b99edeb142e-kube-api-access-8jwwr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:51.947520 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.947435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:51.947520 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:51.947455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.048288 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.048262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.048403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.048299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.048403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.048393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jwwr\" (UniqueName: \"kubernetes.io/projected/b9a14119-8e68-4e71-bbcc-7b99edeb142e-kube-api-access-8jwwr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.048607 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.048589 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.048652 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.048635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.059212 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.059193 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jwwr\" (UniqueName: \"kubernetes.io/projected/b9a14119-8e68-4e71-bbcc-7b99edeb142e-kube-api-access-8jwwr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.211460 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.211402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:52.337231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.337185 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz"] Jun 09 00:25:52.339272 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:25:52.339244 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a14119_8e68_4e71_bbcc_7b99edeb142e.slice/crio-3b38ee2c7411f609ca03793230381f8962a521390892ed1db61a2606aa26df91 WatchSource:0}: Error finding container 3b38ee2c7411f609ca03793230381f8962a521390892ed1db61a2606aa26df91: Status 404 returned error can't find the container with id 3b38ee2c7411f609ca03793230381f8962a521390892ed1db61a2606aa26df91 Jun 09 00:25:52.764993 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.764954 2572 generic.go:356] "Generic (PLEG): container finished" podID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerID="a71745b3e40716f13799193a62cd6d91bb7e1e8e8671127b266f2f107f02bdfa" exitCode=0 Jun 09 00:25:52.765334 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.765051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" event={"ID":"b9a14119-8e68-4e71-bbcc-7b99edeb142e","Type":"ContainerDied","Data":"a71745b3e40716f13799193a62cd6d91bb7e1e8e8671127b266f2f107f02bdfa"} Jun 09 00:25:52.765334 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:52.765111 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" event={"ID":"b9a14119-8e68-4e71-bbcc-7b99edeb142e","Type":"ContainerStarted","Data":"3b38ee2c7411f609ca03793230381f8962a521390892ed1db61a2606aa26df91"} Jun 09 00:25:53.770851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:53.770821 2572 generic.go:356] "Generic (PLEG): container finished" podID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerID="01248a0bcd334d710a3c4077a13439af7cccf4f1c9ae594efc84a89af9ce57f2" exitCode=0 Jun 09 00:25:53.771185 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:53.770912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" event={"ID":"b9a14119-8e68-4e71-bbcc-7b99edeb142e","Type":"ContainerDied","Data":"01248a0bcd334d710a3c4077a13439af7cccf4f1c9ae594efc84a89af9ce57f2"} Jun 09 00:25:54.778767 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:54.778735 2572 generic.go:356] "Generic (PLEG): container finished" podID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerID="dc3e167353151d2b230020f8fd7bf9413a93b5b937e7f803ac1cc215557fc1b6" exitCode=0 Jun 09 00:25:54.779112 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:54.778801 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" event={"ID":"b9a14119-8e68-4e71-bbcc-7b99edeb142e","Type":"ContainerDied","Data":"dc3e167353151d2b230020f8fd7bf9413a93b5b937e7f803ac1cc215557fc1b6"} Jun 09 00:25:55.631169 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.631121 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:55.704431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.704401 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d64774465-6tdt5"] Jun 09 00:25:55.707530 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.707515 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.710306 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.710287 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 00:25:55.711225 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.711202 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 00:25:55.711225 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.711219 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 00:25:55.711416 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.711262 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zntz9\"" Jun 09 00:25:55.711416 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.711320 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 00:25:55.711578 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.711545 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 00:25:55.712358 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.712334 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:25:55.732675 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.732656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d64774465-6tdt5"] Jun 09 00:25:55.779254 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.779236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspjs\" (UniqueName: \"kubernetes.io/projected/a601febb-6a98-451f-933a-74c779fd40c7-kube-api-access-hspjs\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.779659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.779268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a601febb-6a98-451f-933a-74c779fd40c7-manager-config\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.779659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.779308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a601febb-6a98-451f-933a-74c779fd40c7-cert\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.779659 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.779399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a601febb-6a98-451f-933a-74c779fd40c7-metrics-cert\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.879880 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.879855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a601febb-6a98-451f-933a-74c779fd40c7-manager-config\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.880012 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.879901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a601febb-6a98-451f-933a-74c779fd40c7-cert\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.880012 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.879947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a601febb-6a98-451f-933a-74c779fd40c7-metrics-cert\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.880012 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.880006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspjs\" (UniqueName: \"kubernetes.io/projected/a601febb-6a98-451f-933a-74c779fd40c7-kube-api-access-hspjs\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.880577 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.880535 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a601febb-6a98-451f-933a-74c779fd40c7-manager-config\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.882373 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.882325 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a601febb-6a98-451f-933a-74c779fd40c7-metrics-cert\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.882457 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.882390 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a601febb-6a98-451f-933a-74c779fd40c7-cert\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.888107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.888085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspjs\" (UniqueName: \"kubernetes.io/projected/a601febb-6a98-451f-933a-74c779fd40c7-kube-api-access-hspjs\") pod \"lws-controller-manager-d64774465-6tdt5\" (UID: \"a601febb-6a98-451f-933a-74c779fd40c7\") " pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:55.904925 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.904907 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:55.981246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.981222 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-util\") pod \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " Jun 09 00:25:55.981335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.981266 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-bundle\") pod \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " Jun 09 00:25:55.981335 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.981293 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jwwr\" (UniqueName: \"kubernetes.io/projected/b9a14119-8e68-4e71-bbcc-7b99edeb142e-kube-api-access-8jwwr\") pod \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\" (UID: \"b9a14119-8e68-4e71-bbcc-7b99edeb142e\") " Jun 09 00:25:55.982073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.982048 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-bundle" (OuterVolumeSpecName: "bundle") pod "b9a14119-8e68-4e71-bbcc-7b99edeb142e" (UID: "b9a14119-8e68-4e71-bbcc-7b99edeb142e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:25:55.983154 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.983132 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9a14119-8e68-4e71-bbcc-7b99edeb142e-kube-api-access-8jwwr" (OuterVolumeSpecName: "kube-api-access-8jwwr") pod "b9a14119-8e68-4e71-bbcc-7b99edeb142e" (UID: "b9a14119-8e68-4e71-bbcc-7b99edeb142e"). InnerVolumeSpecName "kube-api-access-8jwwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:25:55.989285 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:55.989245 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-util" (OuterVolumeSpecName: "util") pod "b9a14119-8e68-4e71-bbcc-7b99edeb142e" (UID: "b9a14119-8e68-4e71-bbcc-7b99edeb142e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:25:56.016272 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.016248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:25:56.082656 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.082586 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:25:56.082656 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.082615 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jwwr\" (UniqueName: \"kubernetes.io/projected/b9a14119-8e68-4e71-bbcc-7b99edeb142e-kube-api-access-8jwwr\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:25:56.082656 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.082626 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9a14119-8e68-4e71-bbcc-7b99edeb142e-util\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:25:56.139875 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.139842 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d64774465-6tdt5"] Jun 09 00:25:56.142209 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:25:56.142176 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda601febb_6a98_451f_933a_74c779fd40c7.slice/crio-320aa7e6a15f5886ed5603522806b9ed955b8ed8613fb91cfbee01e24ff97dec WatchSource:0}: Error finding container 320aa7e6a15f5886ed5603522806b9ed955b8ed8613fb91cfbee01e24ff97dec: Status 404 returned error can't find the container with id 320aa7e6a15f5886ed5603522806b9ed955b8ed8613fb91cfbee01e24ff97dec Jun 09 00:25:56.789238 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.789205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" event={"ID":"b9a14119-8e68-4e71-bbcc-7b99edeb142e","Type":"ContainerDied","Data":"3b38ee2c7411f609ca03793230381f8962a521390892ed1db61a2606aa26df91"} Jun 09 00:25:56.789608 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.789253 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b38ee2c7411f609ca03793230381f8962a521390892ed1db61a2606aa26df91" Jun 09 00:25:56.789608 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.789218 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdtqwkz" Jun 09 00:25:56.790710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:25:56.790677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" event={"ID":"a601febb-6a98-451f-933a-74c779fd40c7","Type":"ContainerStarted","Data":"320aa7e6a15f5886ed5603522806b9ed955b8ed8613fb91cfbee01e24ff97dec"} Jun 09 00:26:01.814157 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:01.814065 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" event={"ID":"a601febb-6a98-451f-933a-74c779fd40c7","Type":"ContainerStarted","Data":"5e4738845ab699b36183c23b401059f9d811235902ba27cd01b0187d8a8d5fda"} Jun 09 00:26:01.814505 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:01.814195 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:26:01.830314 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:01.830266 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" podStartSLOduration=1.567829352 podStartE2EDuration="6.830251443s" totalImagesPullingTime="5.262422091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:01.829082448 +0000 UTC m=+373.876809887" watchObservedRunningTime="2026-06-09 00:26:01.830251443 +0000 UTC m=+373.877978940" Jun 09 00:26:02.843835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:02.843786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:02.949517 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:02.949489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:03.423688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.423658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:03.610610 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.610585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:03.715938 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.715847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:03.755763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.755736 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b"] Jun 09 00:26:03.756091 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756078 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="util" Jun 09 00:26:03.756158 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756092 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="util" Jun 09 00:26:03.756158 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756126 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="extract" Jun 09 00:26:03.756158 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756134 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="extract" Jun 09 00:26:03.756158 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756141 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="pull" Jun 09 00:26:03.756158 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756147 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="pull" Jun 09 00:26:03.756290 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.756208 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9a14119-8e68-4e71-bbcc-7b99edeb142e" containerName="extract" Jun 09 00:26:03.759302 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.759285 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.763004 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.762983 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 00:26:03.763325 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.763287 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 00:26:03.763614 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.763595 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qtb8w\"" Jun 09 00:26:03.763869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.763850 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 00:26:03.763970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.763949 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 00:26:03.779187 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.779159 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b"] Jun 09 00:26:03.839793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.839774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933b11b1-b3e2-4ce2-84ca-335488d23a44-tmp\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.839901 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.839813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/933b11b1-b3e2-4ce2-84ca-335488d23a44-manifests\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.839901 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.839840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jb62\" (UniqueName: \"kubernetes.io/projected/933b11b1-b3e2-4ce2-84ca-335488d23a44-kube-api-access-4jb62\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.840038 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.839909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/933b11b1-b3e2-4ce2-84ca-335488d23a44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.840038 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.839942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/933b11b1-b3e2-4ce2-84ca-335488d23a44-webhook-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.858716 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.858696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:03.940417 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.940394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/933b11b1-b3e2-4ce2-84ca-335488d23a44-webhook-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.940507 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.940437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933b11b1-b3e2-4ce2-84ca-335488d23a44-tmp\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.940586 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.940565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/933b11b1-b3e2-4ce2-84ca-335488d23a44-manifests\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.940644 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.940607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jb62\" (UniqueName: \"kubernetes.io/projected/933b11b1-b3e2-4ce2-84ca-335488d23a44-kube-api-access-4jb62\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.940696 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.940647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/933b11b1-b3e2-4ce2-84ca-335488d23a44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.940833 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.940805 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/933b11b1-b3e2-4ce2-84ca-335488d23a44-manifests\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.942724 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.942695 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933b11b1-b3e2-4ce2-84ca-335488d23a44-tmp\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.942879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.942859 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/933b11b1-b3e2-4ce2-84ca-335488d23a44-webhook-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.942920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.942867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/933b11b1-b3e2-4ce2-84ca-335488d23a44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.948339 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.948308 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jb62\" (UniqueName: \"kubernetes.io/projected/933b11b1-b3e2-4ce2-84ca-335488d23a44-kube-api-access-4jb62\") pod \"opendatahub-operator-controller-manager-cffbb876-8l48b\" (UID: \"933b11b1-b3e2-4ce2-84ca-335488d23a44\") " pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:03.962495 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:03.962469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:04.067700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:04.067627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:04.072620 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:04.072606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:04.160385 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:04.160360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:04.199641 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:04.199620 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b"] Jun 09 00:26:04.201591 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:26:04.201532 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933b11b1_b3e2_4ce2_84ca_335488d23a44.slice/crio-fc21d6a1a93dd4a5e05f6e57d53650e6dfddf51389c71fdb11a608c0b42d8ca2 WatchSource:0}: Error finding container fc21d6a1a93dd4a5e05f6e57d53650e6dfddf51389c71fdb11a608c0b42d8ca2: Status 404 returned error can't find the container with id fc21d6a1a93dd4a5e05f6e57d53650e6dfddf51389c71fdb11a608c0b42d8ca2 Jun 09 00:26:04.260162 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:04.260141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:04.828794 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:04.828757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" event={"ID":"933b11b1-b3e2-4ce2-84ca-335488d23a44","Type":"ContainerStarted","Data":"fc21d6a1a93dd4a5e05f6e57d53650e6dfddf51389c71fdb11a608c0b42d8ca2"} Jun 09 00:26:07.845324 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:07.845283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" event={"ID":"933b11b1-b3e2-4ce2-84ca-335488d23a44","Type":"ContainerStarted","Data":"18b5cf2361c4aba6c6af3d93e02dc4866c861e9048976978018d0e21da1a85a7"} Jun 09 00:26:08.851073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:08.851037 2572 generic.go:356] "Generic (PLEG): container finished" podID="933b11b1-b3e2-4ce2-84ca-335488d23a44" containerID="18b5cf2361c4aba6c6af3d93e02dc4866c861e9048976978018d0e21da1a85a7" exitCode=0 Jun 09 00:26:08.851415 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:08.851124 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" event={"ID":"933b11b1-b3e2-4ce2-84ca-335488d23a44","Type":"ContainerDied","Data":"18b5cf2361c4aba6c6af3d93e02dc4866c861e9048976978018d0e21da1a85a7"} Jun 09 00:26:09.858872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:09.858840 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" event={"ID":"933b11b1-b3e2-4ce2-84ca-335488d23a44","Type":"ContainerStarted","Data":"8918c028befdfe84320830e16fea9924296739e9dba352cf223001a8c6fc1937"} Jun 09 00:26:09.859268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:09.858944 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:09.883000 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:09.882954 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" podStartSLOduration=2.590673681 podStartE2EDuration="6.882941573s" totalImagesPullingTime="3.350155842s" totalInitContainerRuntime="942.11205ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:09.880946233 +0000 UTC m=+381.928673668" watchObservedRunningTime="2026-06-09 00:26:09.882941573 +0000 UTC m=+381.930669008" Jun 09 00:26:12.820685 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:12.820657 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d64774465-6tdt5" Jun 09 00:26:18.656400 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:18.656364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:18.713141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:18.713084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:20.865288 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:20.865256 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cffbb876-8l48b" Jun 09 00:26:22.948942 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:22.948903 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.087171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.087112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.263300 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.263224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.378988 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.378948 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.463705 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.463679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.574872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.574799 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.644224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.644192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:23.737008 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:23.736976 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:24.165256 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:24.165222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:24.433850 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:24.433768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:32.545347 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:32.545313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:32.666469 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:32.666436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:32.778942 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:32.778903 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:32.893040 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:32.892979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:32.993674 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:32.993630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:33.510674 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:33.510652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:33.673647 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:33.673618 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:33.761431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:33.761349 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:38.438502 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:38.438467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:38.545169 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:38.545143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:39.670644 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:39.670609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:39.800760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:39.800726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:40.328957 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:40.328927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:40.477000 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:40.476971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:40.931365 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:40.931336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:44.273615 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:44.273582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:44.376284 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:44.376256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:51.048545 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:51.048513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:51.098759 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:51.098726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:53.765595 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.765548 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64c7bc99c9-kqdtd"] Jun 09 00:26:53.770984 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.770961 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:53.773647 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.773626 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q9ql9\"" Jun 09 00:26:53.773741 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.773653 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 00:26:53.779585 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.779550 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64c7bc99c9-kqdtd"] Jun 09 00:26:53.795727 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.795699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:26:53.813862 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.813839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98q9\" (UniqueName: \"kubernetes.io/projected/4ad0d4c2-82c1-4e1a-a896-5cc84dca719e-kube-api-access-k98q9\") pod \"dashboard-redirect-64c7bc99c9-kqdtd\" (UID: \"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:53.813945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.813871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ad0d4c2-82c1-4e1a-a896-5cc84dca719e-redirect-config\") pod \"dashboard-redirect-64c7bc99c9-kqdtd\" (UID: \"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:53.915149 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.915123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98q9\" (UniqueName: \"kubernetes.io/projected/4ad0d4c2-82c1-4e1a-a896-5cc84dca719e-kube-api-access-k98q9\") pod \"dashboard-redirect-64c7bc99c9-kqdtd\" (UID: \"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:53.915378 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.915358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ad0d4c2-82c1-4e1a-a896-5cc84dca719e-redirect-config\") pod \"dashboard-redirect-64c7bc99c9-kqdtd\" (UID: \"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:53.916164 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.916139 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ad0d4c2-82c1-4e1a-a896-5cc84dca719e-redirect-config\") pod \"dashboard-redirect-64c7bc99c9-kqdtd\" (UID: \"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:53.922852 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:53.922833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98q9\" (UniqueName: \"kubernetes.io/projected/4ad0d4c2-82c1-4e1a-a896-5cc84dca719e-kube-api-access-k98q9\") pod \"dashboard-redirect-64c7bc99c9-kqdtd\" (UID: \"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e\") " pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:54.082074 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:54.082024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" Jun 09 00:26:54.200786 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:54.200726 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64c7bc99c9-kqdtd"] Jun 09 00:26:54.203606 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:26:54.203582 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad0d4c2_82c1_4e1a_a896_5cc84dca719e.slice/crio-8a86f6368f5c2afecb0c50c0efb7ff0c0e1a8eb22ebfcd561a2a353d0cb1643c WatchSource:0}: Error finding container 8a86f6368f5c2afecb0c50c0efb7ff0c0e1a8eb22ebfcd561a2a353d0cb1643c: Status 404 returned error can't find the container with id 8a86f6368f5c2afecb0c50c0efb7ff0c0e1a8eb22ebfcd561a2a353d0cb1643c Jun 09 00:26:55.076538 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:55.076500 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" event={"ID":"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e","Type":"ContainerStarted","Data":"8a86f6368f5c2afecb0c50c0efb7ff0c0e1a8eb22ebfcd561a2a353d0cb1643c"} Jun 09 00:26:57.088855 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:57.088830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" event={"ID":"4ad0d4c2-82c1-4e1a-a896-5cc84dca719e","Type":"ContainerStarted","Data":"0411dbc4652be6ca4e933b640abb9b1081a29fe8f60f2b3c4eef67efe76508c3"} Jun 09 00:26:57.110031 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:26:57.109989 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64c7bc99c9-kqdtd" podStartSLOduration=1.820912981 podStartE2EDuration="4.109975001s" totalImagesPullingTime="2.28906202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:26:57.107148367 +0000 UTC m=+429.154875802" watchObservedRunningTime="2026-06-09 00:26:57.109975001 +0000 UTC m=+429.157702468" Jun 09 00:27:01.316283 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:01.316192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:11.231663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:11.231615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:11.325409 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:11.325379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:11.773512 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:11.773466 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:14.728325 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.728292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:14.828269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.828239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:14.993304 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.993220 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd"] Jun 09 00:27:14.997004 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.996983 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:14.999329 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.999304 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 00:27:14.999460 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.999331 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 00:27:14.999460 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.999329 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 00:27:14.999699 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:14.999681 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-g9dhk\"" Jun 09 00:27:15.008905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.008884 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd"] Jun 09 00:27:15.033600 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.033578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:15.076511 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076490 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076648 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076648 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076648 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvfpr\" (UniqueName: \"kubernetes.io/projected/a4ad282a-0cf9-41e1-b685-81f7c1302fea-kube-api-access-kvfpr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076648 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076710 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.076853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.076731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177391 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177502 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177502 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177502 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177680 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvfpr\" (UniqueName: \"kubernetes.io/projected/a4ad282a-0cf9-41e1-b685-81f7c1302fea-kube-api-access-kvfpr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177680 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177836 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177934 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177917 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177988 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.177988 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.178080 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.177991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.178130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.178086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.178218 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.178199 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.178270 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.178252 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.179751 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.179731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.180167 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.180148 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.185965 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.185946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4ad282a-0cf9-41e1-b685-81f7c1302fea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.186330 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.186316 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvfpr\" (UniqueName: \"kubernetes.io/projected/a4ad282a-0cf9-41e1-b685-81f7c1302fea-kube-api-access-kvfpr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pcwfd\" (UID: \"a4ad282a-0cf9-41e1-b685-81f7c1302fea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.226072 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.226044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:15.311316 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.311270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:15.324036 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.324013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:15.438243 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:15.438205 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd"] Jun 09 00:27:15.441164 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:15.441138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ad282a_0cf9_41e1_b685_81f7c1302fea.slice/crio-b06e1e5fcd369a069f0db1a45ee5c112e7afdc4ff132f1489334852f9bb405d0 WatchSource:0}: Error finding container b06e1e5fcd369a069f0db1a45ee5c112e7afdc4ff132f1489334852f9bb405d0: Status 404 returned error can't find the container with id b06e1e5fcd369a069f0db1a45ee5c112e7afdc4ff132f1489334852f9bb405d0 Jun 09 00:27:16.177889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:16.177805 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" event={"ID":"a4ad282a-0cf9-41e1-b685-81f7c1302fea","Type":"ContainerStarted","Data":"b06e1e5fcd369a069f0db1a45ee5c112e7afdc4ff132f1489334852f9bb405d0"} Jun 09 00:27:18.068944 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.068898 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:27:18.069227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.068977 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:27:18.069227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.069004 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:27:18.188859 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.188826 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" event={"ID":"a4ad282a-0cf9-41e1-b685-81f7c1302fea","Type":"ContainerStarted","Data":"4701d9ec44631ccf51fcd4341133520de4fc4a4ca1d07902684e7639950b5d3d"} Jun 09 00:27:18.207541 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.207499 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" podStartSLOduration=1.582442537 podStartE2EDuration="4.207482999s" totalImagesPullingTime="2.625040462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:27:18.204966728 +0000 UTC m=+450.252694166" watchObservedRunningTime="2026-06-09 00:27:18.207482999 +0000 UTC m=+450.255210434" Jun 09 00:27:18.312069 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.312044 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:18.457272 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:18.457246 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:19.313656 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:19.313618 2572 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-74759f9795pcwfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jun 09 00:27:19.314024 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:19.313678 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" podUID="a4ad282a-0cf9-41e1-b685-81f7c1302fea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jun 09 00:27:20.315781 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:20.315749 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:21.203405 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:21.203377 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:21.204388 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:21.204369 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pcwfd" Jun 09 00:27:24.467160 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.467099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:24.565139 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.565105 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:24.576375 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.576349 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-stmgc"] Jun 09 00:27:24.582930 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.582910 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:24.585227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.585209 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 00:27:24.586036 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.586020 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 00:27:24.586119 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.586037 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dc7lt\"" Jun 09 00:27:24.591509 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.591419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-stmgc"] Jun 09 00:27:24.651994 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.651971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxfbs\" (UniqueName: \"kubernetes.io/projected/93833324-3c62-4652-9730-a7cec688eabb-kube-api-access-dxfbs\") pod \"kuadrant-operator-catalog-stmgc\" (UID: \"93833324-3c62-4652-9730-a7cec688eabb\") " pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:24.665084 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.665062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:24.752861 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.752811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxfbs\" (UniqueName: \"kubernetes.io/projected/93833324-3c62-4652-9730-a7cec688eabb-kube-api-access-dxfbs\") pod \"kuadrant-operator-catalog-stmgc\" (UID: \"93833324-3c62-4652-9730-a7cec688eabb\") " pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:24.760211 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.760192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxfbs\" (UniqueName: \"kubernetes.io/projected/93833324-3c62-4652-9730-a7cec688eabb-kube-api-access-dxfbs\") pod \"kuadrant-operator-catalog-stmgc\" (UID: \"93833324-3c62-4652-9730-a7cec688eabb\") " pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:24.894624 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.894601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:24.950475 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:24.950437 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-stmgc"] Jun 09 00:27:25.014293 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.014218 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-stmgc"] Jun 09 00:27:25.016915 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:25.016891 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93833324_3c62_4652_9730_a7cec688eabb.slice/crio-18c0437febd1eab602fc9998ff184ac0ce089e5040cecc0b9076c3f0d1b17032 WatchSource:0}: Error finding container 18c0437febd1eab602fc9998ff184ac0ce089e5040cecc0b9076c3f0d1b17032: Status 404 returned error can't find the container with id 18c0437febd1eab602fc9998ff184ac0ce089e5040cecc0b9076c3f0d1b17032 Jun 09 00:27:25.158580 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.158529 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cf5dq"] Jun 09 00:27:25.163002 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.162986 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:25.171848 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.171819 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cf5dq"] Jun 09 00:27:25.224239 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.224215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" event={"ID":"93833324-3c62-4652-9730-a7cec688eabb","Type":"ContainerStarted","Data":"18c0437febd1eab602fc9998ff184ac0ce089e5040cecc0b9076c3f0d1b17032"} Jun 09 00:27:25.257677 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.257652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb822\" (UniqueName: \"kubernetes.io/projected/3b7be235-53ba-4fd3-8102-0ddf22d40bcf-kube-api-access-jb822\") pod \"kuadrant-operator-catalog-cf5dq\" (UID: \"3b7be235-53ba-4fd3-8102-0ddf22d40bcf\") " pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:25.358478 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.358431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb822\" (UniqueName: \"kubernetes.io/projected/3b7be235-53ba-4fd3-8102-0ddf22d40bcf-kube-api-access-jb822\") pod \"kuadrant-operator-catalog-cf5dq\" (UID: \"3b7be235-53ba-4fd3-8102-0ddf22d40bcf\") " pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:25.366688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.366668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb822\" (UniqueName: \"kubernetes.io/projected/3b7be235-53ba-4fd3-8102-0ddf22d40bcf-kube-api-access-jb822\") pod \"kuadrant-operator-catalog-cf5dq\" (UID: \"3b7be235-53ba-4fd3-8102-0ddf22d40bcf\") " pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:25.480539 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.480522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:25.603039 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:25.602999 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cf5dq"] Jun 09 00:27:25.605172 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:25.605138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7be235_53ba_4fd3_8102_0ddf22d40bcf.slice/crio-dab7457382dfe33025369bba2bf4e69e6a990a3161057dfc9bcaf346c0ecde93 WatchSource:0}: Error finding container dab7457382dfe33025369bba2bf4e69e6a990a3161057dfc9bcaf346c0ecde93: Status 404 returned error can't find the container with id dab7457382dfe33025369bba2bf4e69e6a990a3161057dfc9bcaf346c0ecde93 Jun 09 00:27:26.233398 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:26.233167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" event={"ID":"3b7be235-53ba-4fd3-8102-0ddf22d40bcf","Type":"ContainerStarted","Data":"dab7457382dfe33025369bba2bf4e69e6a990a3161057dfc9bcaf346c0ecde93"} Jun 09 00:27:26.241365 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:26.241337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:26.294657 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:26.294607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:28.245593 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.245536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" event={"ID":"93833324-3c62-4652-9730-a7cec688eabb","Type":"ContainerStarted","Data":"065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef"} Jun 09 00:27:28.246002 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.245605 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" podUID="93833324-3c62-4652-9730-a7cec688eabb" containerName="registry-server" containerID="cri-o://065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef" gracePeriod=2 Jun 09 00:27:28.247422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.247394 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" event={"ID":"3b7be235-53ba-4fd3-8102-0ddf22d40bcf","Type":"ContainerStarted","Data":"843d039cc4660091cd083b5cbcc1b11be12e913eb774c86f24261dc0482a1361"} Jun 09 00:27:28.259617 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.259575 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" podStartSLOduration=2.097982334 podStartE2EDuration="4.259547738s" totalImagesPullingTime="2.161565404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:27:28.25884334 +0000 UTC m=+460.306570778" watchObservedRunningTime="2026-06-09 00:27:28.259547738 +0000 UTC m=+460.307275173" Jun 09 00:27:28.272635 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.272588 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" podStartSLOduration=1.6958249250000001 podStartE2EDuration="3.272571807s" totalImagesPullingTime="1.576746882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:27:28.271115154 +0000 UTC m=+460.318842590" watchObservedRunningTime="2026-06-09 00:27:28.272571807 +0000 UTC m=+460.320299240" Jun 09 00:27:28.389798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.389760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:28.439094 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.439067 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:28.488408 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.488378 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:28.590506 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.590451 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxfbs\" (UniqueName: \"kubernetes.io/projected/93833324-3c62-4652-9730-a7cec688eabb-kube-api-access-dxfbs\") pod \"93833324-3c62-4652-9730-a7cec688eabb\" (UID: \"93833324-3c62-4652-9730-a7cec688eabb\") " Jun 09 00:27:28.592237 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.592216 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93833324-3c62-4652-9730-a7cec688eabb-kube-api-access-dxfbs" (OuterVolumeSpecName: "kube-api-access-dxfbs") pod "93833324-3c62-4652-9730-a7cec688eabb" (UID: "93833324-3c62-4652-9730-a7cec688eabb"). InnerVolumeSpecName "kube-api-access-dxfbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:27:28.691900 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:28.691876 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxfbs\" (UniqueName: \"kubernetes.io/projected/93833324-3c62-4652-9730-a7cec688eabb-kube-api-access-dxfbs\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:29.256165 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.256135 2572 generic.go:356] "Generic (PLEG): container finished" podID="93833324-3c62-4652-9730-a7cec688eabb" containerID="065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef" exitCode=0 Jun 09 00:27:29.256515 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.256194 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" Jun 09 00:27:29.256515 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.256227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" event={"ID":"93833324-3c62-4652-9730-a7cec688eabb","Type":"ContainerDied","Data":"065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef"} Jun 09 00:27:29.256515 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.256290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-stmgc" event={"ID":"93833324-3c62-4652-9730-a7cec688eabb","Type":"ContainerDied","Data":"18c0437febd1eab602fc9998ff184ac0ce089e5040cecc0b9076c3f0d1b17032"} Jun 09 00:27:29.256515 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.256321 2572 scope.go:117] "RemoveContainer" containerID="065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef" Jun 09 00:27:29.266433 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.266413 2572 scope.go:117] "RemoveContainer" containerID="065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef" Jun 09 00:27:29.266762 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:27:29.266739 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef\": container with ID starting with 065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef not found: ID does not exist" containerID="065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef" Jun 09 00:27:29.266830 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.266770 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef"} err="failed to get container status \"065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef\": rpc error: code = NotFound desc = could not find container \"065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef\": container with ID starting with 065103c5344d9299f7a21bf2ad9ba0c7481e49671738a47142d2f9669ee731ef not found: ID does not exist" Jun 09 00:27:29.279029 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.278995 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-stmgc"] Jun 09 00:27:29.282282 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:29.282258 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-stmgc"] Jun 09 00:27:30.382249 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:30.382223 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93833324-3c62-4652-9730-a7cec688eabb" path="/var/lib/kubelet/pods/93833324-3c62-4652-9730-a7cec688eabb/volumes" Jun 09 00:27:34.941071 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:34.941035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:35.480688 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:35.480657 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:35.480903 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:35.480703 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:35.503795 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:35.503752 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:36.312762 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:36.312738 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cf5dq" Jun 09 00:27:40.123637 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.123600 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759"] Jun 09 00:27:40.124013 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.123976 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93833324-3c62-4652-9730-a7cec688eabb" containerName="registry-server" Jun 09 00:27:40.124013 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.123990 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="93833324-3c62-4652-9730-a7cec688eabb" containerName="registry-server" Jun 09 00:27:40.124099 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.124058 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="93833324-3c62-4652-9730-a7cec688eabb" containerName="registry-server" Jun 09 00:27:40.135886 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.135859 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759"] Jun 09 00:27:40.136044 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.135950 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.138088 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.138062 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bhwc\"" Jun 09 00:27:40.278284 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.278257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.278401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.278298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsxcs\" (UniqueName: \"kubernetes.io/projected/7fea35a8-be0c-4b65-ac83-f2e1b1791446-kube-api-access-dsxcs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.278401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.278323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.379422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.379352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.379540 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.379488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.379540 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.379517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsxcs\" (UniqueName: \"kubernetes.io/projected/7fea35a8-be0c-4b65-ac83-f2e1b1791446-kube-api-access-dsxcs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.379801 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.379777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.379838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.379825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.387268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.387243 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsxcs\" (UniqueName: \"kubernetes.io/projected/7fea35a8-be0c-4b65-ac83-f2e1b1791446-kube-api-access-dsxcs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.445165 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.445139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:40.573033 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.573009 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759"] Jun 09 00:27:40.574999 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:40.574971 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fea35a8_be0c_4b65_ac83_f2e1b1791446.slice/crio-167aa29911ffcb5e762fe5eb9864a9ae32530c00cadfc4ea53c5b82a21af0a85 WatchSource:0}: Error finding container 167aa29911ffcb5e762fe5eb9864a9ae32530c00cadfc4ea53c5b82a21af0a85: Status 404 returned error can't find the container with id 167aa29911ffcb5e762fe5eb9864a9ae32530c00cadfc4ea53c5b82a21af0a85 Jun 09 00:27:40.726569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.726535 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp"] Jun 09 00:27:40.729877 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.729862 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.736258 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.736235 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp"] Jun 09 00:27:40.882798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.882744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx526\" (UniqueName: \"kubernetes.io/projected/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-kube-api-access-bx526\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.882798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.882795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.882943 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.882883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.983367 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.983332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx526\" (UniqueName: \"kubernetes.io/projected/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-kube-api-access-bx526\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.983496 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.983403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.983496 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.983455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.983797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.983770 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.983908 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.983813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:40.991019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:40.990993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx526\" (UniqueName: \"kubernetes.io/projected/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-kube-api-access-bx526\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:41.041478 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.041445 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:41.162318 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.162295 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp"] Jun 09 00:27:41.164320 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:41.164295 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd904901b_8997_4f6d_8a3d_8e6c34bc7ce4.slice/crio-a44a6f8168fa26e581866ecb9fa64e2b6ac454f8ce767817c932eeef10602fae WatchSource:0}: Error finding container a44a6f8168fa26e581866ecb9fa64e2b6ac454f8ce767817c932eeef10602fae: Status 404 returned error can't find the container with id a44a6f8168fa26e581866ecb9fa64e2b6ac454f8ce767817c932eeef10602fae Jun 09 00:27:41.315567 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.315523 2572 generic.go:356] "Generic (PLEG): container finished" podID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerID="1739c44510cf83e43105e016c0edd1cbe22b0a5522f1135cb3d525e6b08354a1" exitCode=0 Jun 09 00:27:41.315824 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.315592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" event={"ID":"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4","Type":"ContainerDied","Data":"1739c44510cf83e43105e016c0edd1cbe22b0a5522f1135cb3d525e6b08354a1"} Jun 09 00:27:41.315824 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.315650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" event={"ID":"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4","Type":"ContainerStarted","Data":"a44a6f8168fa26e581866ecb9fa64e2b6ac454f8ce767817c932eeef10602fae"} Jun 09 00:27:41.317106 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.317086 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerID="3a36d6d9e5334285f2042a6099353f401bab7a7e8cd552d74bac4d02ab577cb4" exitCode=0 Jun 09 00:27:41.317201 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.317130 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" event={"ID":"7fea35a8-be0c-4b65-ac83-f2e1b1791446","Type":"ContainerDied","Data":"3a36d6d9e5334285f2042a6099353f401bab7a7e8cd552d74bac4d02ab577cb4"} Jun 09 00:27:41.317201 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.317156 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" event={"ID":"7fea35a8-be0c-4b65-ac83-f2e1b1791446","Type":"ContainerStarted","Data":"167aa29911ffcb5e762fe5eb9864a9ae32530c00cadfc4ea53c5b82a21af0a85"} Jun 09 00:27:41.326429 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.326408 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q"] Jun 09 00:27:41.329866 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.329850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.337427 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.337354 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q"] Jun 09 00:27:41.487730 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.487576 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.487730 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.487626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26k9\" (UniqueName: \"kubernetes.io/projected/e68646e1-e4c0-4274-b5e6-469d0a5923b3-kube-api-access-v26k9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.487885 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.487823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.588895 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.588873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.588997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.588901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26k9\" (UniqueName: \"kubernetes.io/projected/e68646e1-e4c0-4274-b5e6-469d0a5923b3-kube-api-access-v26k9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.588997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.588930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.589269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.589251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.589303 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.589271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.596524 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.596500 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26k9\" (UniqueName: \"kubernetes.io/projected/e68646e1-e4c0-4274-b5e6-469d0a5923b3-kube-api-access-v26k9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.640623 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.640602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:41.725636 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.725595 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm"] Jun 09 00:27:41.731006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.730984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.735648 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.735624 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm"] Jun 09 00:27:41.767285 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.767217 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q"] Jun 09 00:27:41.769322 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:41.769299 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68646e1_e4c0_4274_b5e6_469d0a5923b3.slice/crio-b3fc0dc7f43f61f601d7cb6de2e09d284bbc3de30f942d0df12cf57a62a3233b WatchSource:0}: Error finding container b3fc0dc7f43f61f601d7cb6de2e09d284bbc3de30f942d0df12cf57a62a3233b: Status 404 returned error can't find the container with id b3fc0dc7f43f61f601d7cb6de2e09d284bbc3de30f942d0df12cf57a62a3233b Jun 09 00:27:41.892103 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.892079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.892209 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.892134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.892271 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.892239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqvs5\" (UniqueName: \"kubernetes.io/projected/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-kube-api-access-mqvs5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.993433 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.993365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.993433 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.993421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqvs5\" (UniqueName: \"kubernetes.io/projected/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-kube-api-access-mqvs5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.993665 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.993471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.993800 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.993780 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:41.993901 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:41.993880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:42.003061 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.003039 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqvs5\" (UniqueName: \"kubernetes.io/projected/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-kube-api-access-mqvs5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:42.043575 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.043535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:42.269063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.269040 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm"] Jun 09 00:27:42.322774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.322747 2572 generic.go:356] "Generic (PLEG): container finished" podID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerID="c6422137821d917d0b72dfb791be7e7c98ed3bf78404e61de8e1d186ce4edf63" exitCode=0 Jun 09 00:27:42.322857 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.322830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" event={"ID":"e68646e1-e4c0-4274-b5e6-469d0a5923b3","Type":"ContainerDied","Data":"c6422137821d917d0b72dfb791be7e7c98ed3bf78404e61de8e1d186ce4edf63"} Jun 09 00:27:42.322902 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.322877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" event={"ID":"e68646e1-e4c0-4274-b5e6-469d0a5923b3","Type":"ContainerStarted","Data":"b3fc0dc7f43f61f601d7cb6de2e09d284bbc3de30f942d0df12cf57a62a3233b"} Jun 09 00:27:42.324708 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.324687 2572 generic.go:356] "Generic (PLEG): container finished" podID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerID="5053b7506f5c36da7e13cb21ef4faf68b3b7e93567b4054164aad81185fed9a2" exitCode=0 Jun 09 00:27:42.324799 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.324753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" event={"ID":"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4","Type":"ContainerDied","Data":"5053b7506f5c36da7e13cb21ef4faf68b3b7e93567b4054164aad81185fed9a2"} Jun 09 00:27:42.326720 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.326693 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerID="a1bda8c84bc72e3da81c009fa85f6934bb4a52554c3e7d782161c66132a9b96a" exitCode=0 Jun 09 00:27:42.326813 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:42.326755 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" event={"ID":"7fea35a8-be0c-4b65-ac83-f2e1b1791446","Type":"ContainerDied","Data":"a1bda8c84bc72e3da81c009fa85f6934bb4a52554c3e7d782161c66132a9b96a"} Jun 09 00:27:42.342467 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:42.342445 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de55dc7_5ea7_4f38_a1bd_ab804fa1168f.slice/crio-33a089b9cc86a94930d619a6f731cbe2e7323ea7a2b7889ee63f185213a5b07b WatchSource:0}: Error finding container 33a089b9cc86a94930d619a6f731cbe2e7323ea7a2b7889ee63f185213a5b07b: Status 404 returned error can't find the container with id 33a089b9cc86a94930d619a6f731cbe2e7323ea7a2b7889ee63f185213a5b07b Jun 09 00:27:43.332919 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.332894 2572 generic.go:356] "Generic (PLEG): container finished" podID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerID="e6c4d828653f69fe795652435874071c832a9aef93006f1a003177ae418517a0" exitCode=0 Jun 09 00:27:43.333208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.332973 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" event={"ID":"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f","Type":"ContainerDied","Data":"e6c4d828653f69fe795652435874071c832a9aef93006f1a003177ae418517a0"} Jun 09 00:27:43.333208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.333021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" event={"ID":"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f","Type":"ContainerStarted","Data":"33a089b9cc86a94930d619a6f731cbe2e7323ea7a2b7889ee63f185213a5b07b"} Jun 09 00:27:43.334879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.334859 2572 generic.go:356] "Generic (PLEG): container finished" podID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerID="67446be781143f1bde256ce3c70646bb2056b3db5dd30c01c08776f5b54ea612" exitCode=0 Jun 09 00:27:43.335025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.334951 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" event={"ID":"e68646e1-e4c0-4274-b5e6-469d0a5923b3","Type":"ContainerDied","Data":"67446be781143f1bde256ce3c70646bb2056b3db5dd30c01c08776f5b54ea612"} Jun 09 00:27:43.337216 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.337191 2572 generic.go:356] "Generic (PLEG): container finished" podID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerID="27aaa85d9127ee956fa9cf869043390f824d139ad6b22614219e8b5c6d2bad81" exitCode=0 Jun 09 00:27:43.337297 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.337260 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" event={"ID":"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4","Type":"ContainerDied","Data":"27aaa85d9127ee956fa9cf869043390f824d139ad6b22614219e8b5c6d2bad81"} Jun 09 00:27:43.339336 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.339317 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerID="6a5355ccd0a0e051683ec2d063aad84ec4c85a246b99e56f07e35d5208d0d945" exitCode=0 Jun 09 00:27:43.339407 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:43.339376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" event={"ID":"7fea35a8-be0c-4b65-ac83-f2e1b1791446","Type":"ContainerDied","Data":"6a5355ccd0a0e051683ec2d063aad84ec4c85a246b99e56f07e35d5208d0d945"} Jun 09 00:27:44.346796 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.346730 2572 generic.go:356] "Generic (PLEG): container finished" podID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerID="47ae4f2bdb7b5dbeb6ea0b04df8072085c2b8005e657f6d2208764803eb51c48" exitCode=0 Jun 09 00:27:44.347127 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.346817 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" event={"ID":"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f","Type":"ContainerDied","Data":"47ae4f2bdb7b5dbeb6ea0b04df8072085c2b8005e657f6d2208764803eb51c48"} Jun 09 00:27:44.349050 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.349026 2572 generic.go:356] "Generic (PLEG): container finished" podID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerID="fa201fd9a5233e895aa5e5c0eeafe81ad8980e2543598cb9acfbe40da822a0fa" exitCode=0 Jun 09 00:27:44.349138 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.349093 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" event={"ID":"e68646e1-e4c0-4274-b5e6-469d0a5923b3","Type":"ContainerDied","Data":"fa201fd9a5233e895aa5e5c0eeafe81ad8980e2543598cb9acfbe40da822a0fa"} Jun 09 00:27:44.485273 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.485248 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:44.558521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.558502 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:44.616989 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.616938 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-util\") pod \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " Jun 09 00:27:44.617076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.616995 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx526\" (UniqueName: \"kubernetes.io/projected/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-kube-api-access-bx526\") pod \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " Jun 09 00:27:44.617076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.617039 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-bundle\") pod \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\" (UID: \"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4\") " Jun 09 00:27:44.617660 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.617641 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-bundle" (OuterVolumeSpecName: "bundle") pod "d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" (UID: "d904901b-8997-4f6d-8a3d-8e6c34bc7ce4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:44.618860 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.618841 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-kube-api-access-bx526" (OuterVolumeSpecName: "kube-api-access-bx526") pod "d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" (UID: "d904901b-8997-4f6d-8a3d-8e6c34bc7ce4"). InnerVolumeSpecName "kube-api-access-bx526". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:27:44.624223 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.624187 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-util" (OuterVolumeSpecName: "util") pod "d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" (UID: "d904901b-8997-4f6d-8a3d-8e6c34bc7ce4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:44.717593 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.717549 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsxcs\" (UniqueName: \"kubernetes.io/projected/7fea35a8-be0c-4b65-ac83-f2e1b1791446-kube-api-access-dsxcs\") pod \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " Jun 09 00:27:44.717762 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.717606 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-util\") pod \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " Jun 09 00:27:44.717762 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.717628 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-bundle\") pod \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\" (UID: \"7fea35a8-be0c-4b65-ac83-f2e1b1791446\") " Jun 09 00:27:44.717879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.717811 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-util\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:44.717879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.717820 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx526\" (UniqueName: \"kubernetes.io/projected/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-kube-api-access-bx526\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:44.717879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.717829 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d904901b-8997-4f6d-8a3d-8e6c34bc7ce4-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:44.718124 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.718100 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-bundle" (OuterVolumeSpecName: "bundle") pod "7fea35a8-be0c-4b65-ac83-f2e1b1791446" (UID: "7fea35a8-be0c-4b65-ac83-f2e1b1791446"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:44.719504 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.719481 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fea35a8-be0c-4b65-ac83-f2e1b1791446-kube-api-access-dsxcs" (OuterVolumeSpecName: "kube-api-access-dsxcs") pod "7fea35a8-be0c-4b65-ac83-f2e1b1791446" (UID: "7fea35a8-be0c-4b65-ac83-f2e1b1791446"). InnerVolumeSpecName "kube-api-access-dsxcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:27:44.722760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.722727 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-util" (OuterVolumeSpecName: "util") pod "7fea35a8-be0c-4b65-ac83-f2e1b1791446" (UID: "7fea35a8-be0c-4b65-ac83-f2e1b1791446"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:44.818188 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.818162 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsxcs\" (UniqueName: \"kubernetes.io/projected/7fea35a8-be0c-4b65-ac83-f2e1b1791446-kube-api-access-dsxcs\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:44.818188 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.818187 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-util\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:44.818332 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:44.818200 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fea35a8-be0c-4b65-ac83-f2e1b1791446-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:45.356954 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.356922 2572 generic.go:356] "Generic (PLEG): container finished" podID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerID="86025c3800434d5ba7fe73d0bcafbc3a092f52a760ae94c4ee5605b579aeab18" exitCode=0 Jun 09 00:27:45.357287 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.357016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" event={"ID":"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f","Type":"ContainerDied","Data":"86025c3800434d5ba7fe73d0bcafbc3a092f52a760ae94c4ee5605b579aeab18"} Jun 09 00:27:45.359355 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.359336 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" Jun 09 00:27:45.359450 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.359337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp" event={"ID":"d904901b-8997-4f6d-8a3d-8e6c34bc7ce4","Type":"ContainerDied","Data":"a44a6f8168fa26e581866ecb9fa64e2b6ac454f8ce767817c932eeef10602fae"} Jun 09 00:27:45.359514 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.359463 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a44a6f8168fa26e581866ecb9fa64e2b6ac454f8ce767817c932eeef10602fae" Jun 09 00:27:45.361676 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.361655 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" Jun 09 00:27:45.361758 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.361677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759" event={"ID":"7fea35a8-be0c-4b65-ac83-f2e1b1791446","Type":"ContainerDied","Data":"167aa29911ffcb5e762fe5eb9864a9ae32530c00cadfc4ea53c5b82a21af0a85"} Jun 09 00:27:45.361758 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.361709 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="167aa29911ffcb5e762fe5eb9864a9ae32530c00cadfc4ea53c5b82a21af0a85" Jun 09 00:27:45.498171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.498143 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:45.625996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.625939 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v26k9\" (UniqueName: \"kubernetes.io/projected/e68646e1-e4c0-4274-b5e6-469d0a5923b3-kube-api-access-v26k9\") pod \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " Jun 09 00:27:45.626094 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.625999 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-bundle\") pod \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " Jun 09 00:27:45.626094 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.626031 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-util\") pod \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\" (UID: \"e68646e1-e4c0-4274-b5e6-469d0a5923b3\") " Jun 09 00:27:45.626445 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.626414 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-bundle" (OuterVolumeSpecName: "bundle") pod "e68646e1-e4c0-4274-b5e6-469d0a5923b3" (UID: "e68646e1-e4c0-4274-b5e6-469d0a5923b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:45.627878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.627852 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68646e1-e4c0-4274-b5e6-469d0a5923b3-kube-api-access-v26k9" (OuterVolumeSpecName: "kube-api-access-v26k9") pod "e68646e1-e4c0-4274-b5e6-469d0a5923b3" (UID: "e68646e1-e4c0-4274-b5e6-469d0a5923b3"). InnerVolumeSpecName "kube-api-access-v26k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:27:45.631375 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.631339 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-util" (OuterVolumeSpecName: "util") pod "e68646e1-e4c0-4274-b5e6-469d0a5923b3" (UID: "e68646e1-e4c0-4274-b5e6-469d0a5923b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:45.726889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.726857 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:45.726889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.726888 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e68646e1-e4c0-4274-b5e6-469d0a5923b3-util\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:45.726889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:45.726896 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v26k9\" (UniqueName: \"kubernetes.io/projected/e68646e1-e4c0-4274-b5e6-469d0a5923b3-kube-api-access-v26k9\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:46.368783 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.368762 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" Jun 09 00:27:46.369076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.368789 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q" event={"ID":"e68646e1-e4c0-4274-b5e6-469d0a5923b3","Type":"ContainerDied","Data":"b3fc0dc7f43f61f601d7cb6de2e09d284bbc3de30f942d0df12cf57a62a3233b"} Jun 09 00:27:46.369076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.368841 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3fc0dc7f43f61f601d7cb6de2e09d284bbc3de30f942d0df12cf57a62a3233b" Jun 09 00:27:46.492780 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.492759 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:46.635646 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.635583 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-util\") pod \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " Jun 09 00:27:46.635646 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.635620 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqvs5\" (UniqueName: \"kubernetes.io/projected/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-kube-api-access-mqvs5\") pod \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " Jun 09 00:27:46.635646 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.635642 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-bundle\") pod \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\" (UID: \"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f\") " Jun 09 00:27:46.636089 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.636067 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-bundle" (OuterVolumeSpecName: "bundle") pod "5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" (UID: "5de55dc7-5ea7-4f38-a1bd-ab804fa1168f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:46.637535 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.637512 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-kube-api-access-mqvs5" (OuterVolumeSpecName: "kube-api-access-mqvs5") pod "5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" (UID: "5de55dc7-5ea7-4f38-a1bd-ab804fa1168f"). InnerVolumeSpecName "kube-api-access-mqvs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:27:46.640774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.640740 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-util" (OuterVolumeSpecName: "util") pod "5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" (UID: "5de55dc7-5ea7-4f38-a1bd-ab804fa1168f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:27:46.736843 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.736823 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-util\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:46.736843 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.736843 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqvs5\" (UniqueName: \"kubernetes.io/projected/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-kube-api-access-mqvs5\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:46.736961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:46.736853 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5de55dc7-5ea7-4f38-a1bd-ab804fa1168f-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:27:47.376240 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:47.376215 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" Jun 09 00:27:47.376641 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:47.376247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm" event={"ID":"5de55dc7-5ea7-4f38-a1bd-ab804fa1168f","Type":"ContainerDied","Data":"33a089b9cc86a94930d619a6f731cbe2e7323ea7a2b7889ee63f185213a5b07b"} Jun 09 00:27:47.376641 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:47.376323 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33a089b9cc86a94930d619a6f731cbe2e7323ea7a2b7889ee63f185213a5b07b" Jun 09 00:27:53.744716 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:53.744680 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:54.045497 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:54.045417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:54.145220 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:54.145168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:56.364300 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364267 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv"] Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364616 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364628 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364640 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364645 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364657 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="util" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364662 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="util" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364669 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="util" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364676 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="util" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364684 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364689 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364694 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="util" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364699 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="util" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364706 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364710 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="pull" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364717 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="extract" Jun 09 00:27:56.364717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364722 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364732 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="util" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364737 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="util" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364746 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364754 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364761 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364766 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364772 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364777 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364824 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fea35a8-be0c-4b65-ac83-f2e1b1791446" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364836 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68646e1-e4c0-4274-b5e6-469d0a5923b3" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364843 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5de55dc7-5ea7-4f38-a1bd-ab804fa1168f" containerName="extract" Jun 09 00:27:56.365166 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.364848 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d904901b-8997-4f6d-8a3d-8e6c34bc7ce4" containerName="extract" Jun 09 00:27:56.373498 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.373481 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:27:56.375995 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.375947 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 00:27:56.376127 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.376101 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kd5zd\"" Jun 09 00:27:56.376945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.376921 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv"] Jun 09 00:27:56.408047 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.408026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzxl\" (UniqueName: \"kubernetes.io/projected/9f02aa10-68d4-4cdf-863e-5c56bd7cedf6-kube-api-access-vtzxl\") pod \"dns-operator-controller-manager-864dd78c4c-7sgtv\" (UID: \"9f02aa10-68d4-4cdf-863e-5c56bd7cedf6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:27:56.508743 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.508719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzxl\" (UniqueName: \"kubernetes.io/projected/9f02aa10-68d4-4cdf-863e-5c56bd7cedf6-kube-api-access-vtzxl\") pod \"dns-operator-controller-manager-864dd78c4c-7sgtv\" (UID: \"9f02aa10-68d4-4cdf-863e-5c56bd7cedf6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:27:56.517531 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.517510 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzxl\" (UniqueName: \"kubernetes.io/projected/9f02aa10-68d4-4cdf-863e-5c56bd7cedf6-kube-api-access-vtzxl\") pod \"dns-operator-controller-manager-864dd78c4c-7sgtv\" (UID: \"9f02aa10-68d4-4cdf-863e-5c56bd7cedf6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:27:56.684922 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.684898 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:27:56.843032 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:56.843006 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv"] Jun 09 00:27:56.844873 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:27:56.844848 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f02aa10_68d4_4cdf_863e_5c56bd7cedf6.slice/crio-9fedf500a8134406165b7a258d6fb97e299aae770114d84c5ce18eb15ef99579 WatchSource:0}: Error finding container 9fedf500a8134406165b7a258d6fb97e299aae770114d84c5ce18eb15ef99579: Status 404 returned error can't find the container with id 9fedf500a8134406165b7a258d6fb97e299aae770114d84c5ce18eb15ef99579 Jun 09 00:27:57.335815 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:57.335784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:27:57.426449 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:57.426420 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" event={"ID":"9f02aa10-68d4-4cdf-863e-5c56bd7cedf6","Type":"ContainerStarted","Data":"9fedf500a8134406165b7a258d6fb97e299aae770114d84c5ce18eb15ef99579"} Jun 09 00:27:59.437087 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:59.437064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" event={"ID":"9f02aa10-68d4-4cdf-863e-5c56bd7cedf6","Type":"ContainerStarted","Data":"02e7d612cfd4509231cdadd8392b638129464910b81a86652047adca0727f93f"} Jun 09 00:27:59.437364 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:59.437177 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:27:59.466269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:27:59.466228 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" podStartSLOduration=1.086206922 podStartE2EDuration="3.466212476s" totalImagesPullingTime="2.380005554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:27:59.465293404 +0000 UTC m=+491.513020862" watchObservedRunningTime="2026-06-09 00:27:59.466212476 +0000 UTC m=+491.513939911" Jun 09 00:28:00.364617 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:00.364589 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:01.343753 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.343722 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4"] Jun 09 00:28:01.347337 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.347316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.349732 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.349714 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-frs22\"" Jun 09 00:28:01.371228 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.371203 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4"] Jun 09 00:28:01.444277 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.444254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.444381 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.444309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t427g\" (UniqueName: \"kubernetes.io/projected/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-kube-api-access-t427g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.544926 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.544899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t427g\" (UniqueName: \"kubernetes.io/projected/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-kube-api-access-t427g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.545029 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.544962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.545277 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.545258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.556272 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.556239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t427g\" (UniqueName: \"kubernetes.io/projected/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-kube-api-access-t427g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.657389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.657369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:01.807673 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.807643 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4"] Jun 09 00:28:01.809491 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:28:01.809472 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a89cb3_4ef4_4f75_908f_ab6f93e9b2c4.slice/crio-3e4b49fe3aa0898b11947237b9caab1ee43af1bafd2379413350b7056d28782a WatchSource:0}: Error finding container 3e4b49fe3aa0898b11947237b9caab1ee43af1bafd2379413350b7056d28782a: Status 404 returned error can't find the container with id 3e4b49fe3aa0898b11947237b9caab1ee43af1bafd2379413350b7056d28782a Jun 09 00:28:01.844778 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:01.844743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:02.453962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:02.453925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" event={"ID":"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4","Type":"ContainerStarted","Data":"3e4b49fe3aa0898b11947237b9caab1ee43af1bafd2379413350b7056d28782a"} Jun 09 00:28:02.543011 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:02.542974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:04.493071 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.493043 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz"] Jun 09 00:28:04.496925 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.496903 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:04.499885 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.499871 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g9fbb\"" Jun 09 00:28:04.505218 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.505191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz"] Jun 09 00:28:04.570926 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.570906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhl2b\" (UniqueName: \"kubernetes.io/projected/760926fd-02b8-4a9a-bc3d-133ee902119d-kube-api-access-hhl2b\") pod \"limitador-operator-controller-manager-859d7b78bd-gmssz\" (UID: \"760926fd-02b8-4a9a-bc3d-133ee902119d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:04.671935 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.671908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhl2b\" (UniqueName: \"kubernetes.io/projected/760926fd-02b8-4a9a-bc3d-133ee902119d-kube-api-access-hhl2b\") pod \"limitador-operator-controller-manager-859d7b78bd-gmssz\" (UID: \"760926fd-02b8-4a9a-bc3d-133ee902119d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:04.679886 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.679865 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhl2b\" (UniqueName: \"kubernetes.io/projected/760926fd-02b8-4a9a-bc3d-133ee902119d-kube-api-access-hhl2b\") pod \"limitador-operator-controller-manager-859d7b78bd-gmssz\" (UID: \"760926fd-02b8-4a9a-bc3d-133ee902119d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:04.807819 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.807762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:04.921979 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.921952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:04.942390 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:04.942368 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz"] Jun 09 00:28:04.944428 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:28:04.944397 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760926fd_02b8_4a9a_bc3d_133ee902119d.slice/crio-cff4540526ee662e967d869e54773ab617e4aabbcb22ad28af8d4fece531e087 WatchSource:0}: Error finding container cff4540526ee662e967d869e54773ab617e4aabbcb22ad28af8d4fece531e087: Status 404 returned error can't find the container with id cff4540526ee662e967d869e54773ab617e4aabbcb22ad28af8d4fece531e087 Jun 09 00:28:05.471152 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:05.471121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" event={"ID":"760926fd-02b8-4a9a-bc3d-133ee902119d","Type":"ContainerStarted","Data":"cff4540526ee662e967d869e54773ab617e4aabbcb22ad28af8d4fece531e087"} Jun 09 00:28:05.532137 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:05.532102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:05.973933 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:05.973877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:06.076650 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:06.076619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:07.483290 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:07.483254 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" event={"ID":"760926fd-02b8-4a9a-bc3d-133ee902119d","Type":"ContainerStarted","Data":"f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48"} Jun 09 00:28:07.483716 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:07.483359 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:07.501538 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:07.501488 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" podStartSLOduration=1.5696492850000001 podStartE2EDuration="3.501468817s" totalImagesPullingTime="1.931819532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:07.500697215 +0000 UTC m=+499.548424651" watchObservedRunningTime="2026-06-09 00:28:07.501468817 +0000 UTC m=+499.549196254" Jun 09 00:28:08.788312 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:08.788277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:10.132723 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:10.132699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:10.227696 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:10.227671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:10.444581 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:10.444542 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7sgtv" Jun 09 00:28:10.504410 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:10.504351 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" event={"ID":"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4","Type":"ContainerStarted","Data":"a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd"} Jun 09 00:28:10.504576 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:10.504462 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:10.525171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:10.525125 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" podStartSLOduration=1.280671737 podStartE2EDuration="9.525111983s" totalImagesPullingTime="8.244440246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:10.523578923 +0000 UTC m=+502.571306358" watchObservedRunningTime="2026-06-09 00:28:10.525111983 +0000 UTC m=+502.572839418" Jun 09 00:28:12.744407 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:12.744373 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:13.000610 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:13.000488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:13.535480 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:13.535453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:13.596227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:13.596199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:13.731144 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:13.731112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:13.796168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:13.796114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:18.492177 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:18.492148 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:21.148778 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:21.148737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:21.251714 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:21.251685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:21.511745 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:21.511675 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:22.921877 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:22.921837 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px"] Jun 09 00:28:22.926907 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:22.926887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:22.942080 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:22.942059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px"] Jun 09 00:28:23.001338 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.001313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31ac29d3-804a-4609-8eaf-412985e59cda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-286px\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.001422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.001349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cfs\" (UniqueName: \"kubernetes.io/projected/31ac29d3-804a-4609-8eaf-412985e59cda-kube-api-access-c5cfs\") pod \"kuadrant-operator-controller-manager-55467d9f7-286px\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.101846 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.101796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31ac29d3-804a-4609-8eaf-412985e59cda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-286px\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.101961 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.101896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cfs\" (UniqueName: \"kubernetes.io/projected/31ac29d3-804a-4609-8eaf-412985e59cda-kube-api-access-c5cfs\") pod \"kuadrant-operator-controller-manager-55467d9f7-286px\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.102155 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.102124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31ac29d3-804a-4609-8eaf-412985e59cda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-286px\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.113906 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.113888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cfs\" (UniqueName: \"kubernetes.io/projected/31ac29d3-804a-4609-8eaf-412985e59cda-kube-api-access-c5cfs\") pod \"kuadrant-operator-controller-manager-55467d9f7-286px\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.204899 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.204847 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px"] Jun 09 00:28:23.205026 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.205015 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:23.210389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.210368 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px"] Jun 09 00:28:23.219070 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.219051 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4"] Jun 09 00:28:23.219291 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.219233 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" containerName="manager" containerID="cri-o://a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd" gracePeriod=2 Jun 09 00:28:23.237427 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.237393 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc"] Jun 09 00:28:23.241160 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.241143 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4"] Jun 09 00:28:23.241246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.241223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.247681 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.247654 2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.250115 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.249934 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.252700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.252678 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz"] Jun 09 00:28:23.252897 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.252870 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" containerName="manager" containerID="cri-o://f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48" gracePeriod=2 Jun 09 00:28:23.257145 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.256705 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c"] Jun 09 00:28:23.257258 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.257184 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" containerName="manager" Jun 09 00:28:23.257258 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.257197 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" containerName="manager" Jun 09 00:28:23.257258 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.257253 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" containerName="manager" Jun 09 00:28:23.260761 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.260742 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc"] Jun 09 00:28:23.260858 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.260811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.270721 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.270700 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz"] Jun 09 00:28:23.273122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.273100 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c"] Jun 09 00:28:23.275307 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.275279 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.303332 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.303305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gwt\" (UniqueName: \"kubernetes.io/projected/800d68e6-29d1-4371-9817-eafa3cd9cc0f-kube-api-access-j9gwt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vqb2c\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.303451 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.303362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzw4f\" (UniqueName: \"kubernetes.io/projected/8bc58a0e-98e4-4b02-8891-f668c970a7bc-kube-api-access-mzw4f\") pod \"kuadrant-operator-controller-manager-55467d9f7-2zdjc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.303536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.303475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bc58a0e-98e4-4b02-8891-f668c970a7bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2zdjc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.303536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.303527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d68e6-29d1-4371-9817-eafa3cd9cc0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vqb2c\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.309592 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.309542 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.404392 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.404357 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gwt\" (UniqueName: \"kubernetes.io/projected/800d68e6-29d1-4371-9817-eafa3cd9cc0f-kube-api-access-j9gwt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vqb2c\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.404573 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.404409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzw4f\" (UniqueName: \"kubernetes.io/projected/8bc58a0e-98e4-4b02-8891-f668c970a7bc-kube-api-access-mzw4f\") pod \"kuadrant-operator-controller-manager-55467d9f7-2zdjc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.404573 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.404461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bc58a0e-98e4-4b02-8891-f668c970a7bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2zdjc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.404573 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.404501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d68e6-29d1-4371-9817-eafa3cd9cc0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vqb2c\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.404872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.404854 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d68e6-29d1-4371-9817-eafa3cd9cc0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vqb2c\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.404935 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.404904 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bc58a0e-98e4-4b02-8891-f668c970a7bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2zdjc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.426707 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.426678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzw4f\" (UniqueName: \"kubernetes.io/projected/8bc58a0e-98e4-4b02-8891-f668c970a7bc-kube-api-access-mzw4f\") pod \"kuadrant-operator-controller-manager-55467d9f7-2zdjc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.426861 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.426836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gwt\" (UniqueName: \"kubernetes.io/projected/800d68e6-29d1-4371-9817-eafa3cd9cc0f-kube-api-access-j9gwt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vqb2c\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.473694 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.473675 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.476020 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.475993 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.476666 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.476651 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.477981 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.477961 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.479968 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.479945 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.481928 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.481906 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.505232 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.505209 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-extensions-socket-volume\") pod \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " Jun 09 00:28:23.505303 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.505264 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhl2b\" (UniqueName: \"kubernetes.io/projected/760926fd-02b8-4a9a-bc3d-133ee902119d-kube-api-access-hhl2b\") pod \"760926fd-02b8-4a9a-bc3d-133ee902119d\" (UID: \"760926fd-02b8-4a9a-bc3d-133ee902119d\") " Jun 09 00:28:23.505346 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.505319 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t427g\" (UniqueName: \"kubernetes.io/projected/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-kube-api-access-t427g\") pod \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\" (UID: \"99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4\") " Jun 09 00:28:23.505658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.505637 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" (UID: "99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:28:23.507218 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.507198 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-kube-api-access-t427g" (OuterVolumeSpecName: "kube-api-access-t427g") pod "99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" (UID: "99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4"). InnerVolumeSpecName "kube-api-access-t427g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:28:23.507282 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.507226 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/760926fd-02b8-4a9a-bc3d-133ee902119d-kube-api-access-hhl2b" (OuterVolumeSpecName: "kube-api-access-hhl2b") pod "760926fd-02b8-4a9a-bc3d-133ee902119d" (UID: "760926fd-02b8-4a9a-bc3d-133ee902119d"). InnerVolumeSpecName "kube-api-access-hhl2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:28:23.576400 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.576382 2572 generic.go:356] "Generic (PLEG): container finished" podID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" containerID="a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd" exitCode=0 Jun 09 00:28:23.576489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.576418 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.576489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.576473 2572 scope.go:117] "RemoveContainer" containerID="a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd" Jun 09 00:28:23.577899 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.577878 2572 generic.go:356] "Generic (PLEG): container finished" podID="760926fd-02b8-4a9a-bc3d-133ee902119d" containerID="f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48" exitCode=0 Jun 09 00:28:23.577979 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.577928 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.578876 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.578858 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.583113 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.582714 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.587655 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.584720 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.587655 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.586540 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.592338 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.592321 2572 scope.go:117] "RemoveContainer" containerID="a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd" Jun 09 00:28:23.592593 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.592575 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd\": container with ID starting with a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd not found: ID does not exist" containerID="a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd" Jun 09 00:28:23.592638 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.592599 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd"} err="failed to get container status \"a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd\": rpc error: code = NotFound desc = could not find container \"a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd\": container with ID starting with a87e14a1dde48b33b53ba7d7f610e4f83a6970f4436fae8ffe3d21259c4610dd not found: ID does not exist" Jun 09 00:28:23.592638 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.592614 2572 scope.go:117] "RemoveContainer" containerID="f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48" Jun 09 00:28:23.593153 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.593133 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.594770 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.594751 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.596447 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.596422 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d9qs4\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d9qs4" Jun 09 00:28:23.598044 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.598021 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmssz\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmssz" Jun 09 00:28:23.600111 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.600096 2572 scope.go:117] "RemoveContainer" containerID="f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48" Jun 09 00:28:23.600315 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:23.600298 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48\": container with ID starting with f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48 not found: ID does not exist" containerID="f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48" Jun 09 00:28:23.600368 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.600326 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48"} err="failed to get container status \"f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48\": rpc error: code = NotFound desc = could not find container \"f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48\": container with ID starting with f63104bcd42f26be9ad7afc2e9e8d670ac49223a1d0e2634ca6e3a0063e71b48 not found: ID does not exist" Jun 09 00:28:23.606732 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.606715 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-extensions-socket-volume\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:23.606793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.606734 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhl2b\" (UniqueName: \"kubernetes.io/projected/760926fd-02b8-4a9a-bc3d-133ee902119d-kube-api-access-hhl2b\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:23.606793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.606743 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t427g\" (UniqueName: \"kubernetes.io/projected/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4-kube-api-access-t427g\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:23.672387 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.672366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:23.681130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.681111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:23.818178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.817707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc"] Jun 09 00:28:23.820193 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:28:23.820171 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc58a0e_98e4_4b02_8891_f668c970a7bc.slice/crio-38535d24d400a7fad6596ee96fd2884d1d54035c9090518405bc387ec9e1e859 WatchSource:0}: Error finding container 38535d24d400a7fad6596ee96fd2884d1d54035c9090518405bc387ec9e1e859: Status 404 returned error can't find the container with id 38535d24d400a7fad6596ee96fd2884d1d54035c9090518405bc387ec9e1e859 Jun 09 00:28:23.832385 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:23.832362 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c"] Jun 09 00:28:23.834074 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:28:23.834054 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800d68e6_29d1_4371_9817_eafa3cd9cc0f.slice/crio-295879bfaaf7721af0afa9915284d58c03440e2c710c36741f09a4cb6108b100 WatchSource:0}: Error finding container 295879bfaaf7721af0afa9915284d58c03440e2c710c36741f09a4cb6108b100: Status 404 returned error can't find the container with id 295879bfaaf7721af0afa9915284d58c03440e2c710c36741f09a4cb6108b100 Jun 09 00:28:24.383700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.383621 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" path="/var/lib/kubelet/pods/760926fd-02b8-4a9a-bc3d-133ee902119d/volumes" Jun 09 00:28:24.384069 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.383935 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4" path="/var/lib/kubelet/pods/99a89cb3-4ef4-4f75-908f-ab6f93e9b2c4/volumes" Jun 09 00:28:24.531882 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.531853 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585995749-dn4rx"] Jun 09 00:28:24.590700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.590665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" event={"ID":"800d68e6-29d1-4371-9817-eafa3cd9cc0f","Type":"ContainerStarted","Data":"67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47"} Jun 09 00:28:24.590889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.590718 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" event={"ID":"800d68e6-29d1-4371-9817-eafa3cd9cc0f","Type":"ContainerStarted","Data":"295879bfaaf7721af0afa9915284d58c03440e2c710c36741f09a4cb6108b100"} Jun 09 00:28:24.590889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.590765 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:24.592173 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.592149 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" event={"ID":"8bc58a0e-98e4-4b02-8891-f668c970a7bc","Type":"ContainerStarted","Data":"3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f"} Jun 09 00:28:24.592265 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.592191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" event={"ID":"8bc58a0e-98e4-4b02-8891-f668c970a7bc","Type":"ContainerStarted","Data":"38535d24d400a7fad6596ee96fd2884d1d54035c9090518405bc387ec9e1e859"} Jun 09 00:28:24.612587 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.612532 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" podStartSLOduration=1.6125178610000002 podStartE2EDuration="1.612517861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:24.610323479 +0000 UTC m=+516.658050915" watchObservedRunningTime="2026-06-09 00:28:24.612517861 +0000 UTC m=+516.660245296" Jun 09 00:28:24.631098 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.631041 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" podStartSLOduration=1.6310254149999999 podStartE2EDuration="1.631025415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:24.629257643 +0000 UTC m=+516.676985082" watchObservedRunningTime="2026-06-09 00:28:24.631025415 +0000 UTC m=+516.678752851" Jun 09 00:28:24.685287 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.685264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:24.784844 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.784822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:24.889997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:24.889971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:25.597448 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:25.597424 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:25.754229 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:25.754193 2572 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-286px_kuadrant-system_31ac29d3-804a-4609-8eaf-412985e59cda_0(e438b35d0e91484ff669107f642cd302c8d31f1662ded13c5f6d3e89e285ba4a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-286px to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 09 00:28:25.754317 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:25.754252 2572 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-286px_kuadrant-system_31ac29d3-804a-4609-8eaf-412985e59cda_0(e438b35d0e91484ff669107f642cd302c8d31f1662ded13c5f6d3e89e285ba4a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-286px to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:25.956035 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:25.956011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:26.055799 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.055775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:26.156963 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.156933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:26.602541 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.602517 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:26.611122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.611103 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:26.612967 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:26.612944 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-286px\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="31ac29d3-804a-4609-8eaf-412985e59cda" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:26.731706 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.731674 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31ac29d3-804a-4609-8eaf-412985e59cda-extensions-socket-volume\") pod \"31ac29d3-804a-4609-8eaf-412985e59cda\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " Jun 09 00:28:26.731834 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.731711 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5cfs\" (UniqueName: \"kubernetes.io/projected/31ac29d3-804a-4609-8eaf-412985e59cda-kube-api-access-c5cfs\") pod \"31ac29d3-804a-4609-8eaf-412985e59cda\" (UID: \"31ac29d3-804a-4609-8eaf-412985e59cda\") " Jun 09 00:28:26.731923 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.731895 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ac29d3-804a-4609-8eaf-412985e59cda-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31ac29d3-804a-4609-8eaf-412985e59cda" (UID: "31ac29d3-804a-4609-8eaf-412985e59cda"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:28:26.731987 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.731970 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31ac29d3-804a-4609-8eaf-412985e59cda-extensions-socket-volume\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:26.733870 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.733839 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ac29d3-804a-4609-8eaf-412985e59cda-kube-api-access-c5cfs" (OuterVolumeSpecName: "kube-api-access-c5cfs") pod "31ac29d3-804a-4609-8eaf-412985e59cda" (UID: "31ac29d3-804a-4609-8eaf-412985e59cda"). InnerVolumeSpecName "kube-api-access-c5cfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:28:26.833294 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:26.833258 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5cfs\" (UniqueName: \"kubernetes.io/projected/31ac29d3-804a-4609-8eaf-412985e59cda-kube-api-access-c5cfs\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:27.607881 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:27.607855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:27.610142 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:27.610110 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-286px\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="31ac29d3-804a-4609-8eaf-412985e59cda" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:27.615266 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:27.615237 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-286px\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="31ac29d3-804a-4609-8eaf-412985e59cda" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:28.383101 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:28.383073 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-286px\" is forbidden: User \"system:node:ip-10-0-140-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-224.ec2.internal' and this object" podUID="31ac29d3-804a-4609-8eaf-412985e59cda" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-286px" Jun 09 00:28:28.384599 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:28.384576 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ac29d3-804a-4609-8eaf-412985e59cda" path="/var/lib/kubelet/pods/31ac29d3-804a-4609-8eaf-412985e59cda/volumes" Jun 09 00:28:28.427718 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:28.427697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:28.526359 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:28.526337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:31.776244 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:31.776208 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:31.875252 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:31.875222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:35.599394 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:35.599362 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:36.605267 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.605235 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:36.647670 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.647641 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c"] Jun 09 00:28:36.647848 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.647810 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" podUID="800d68e6-29d1-4371-9817-eafa3cd9cc0f" containerName="manager" containerID="cri-o://67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47" gracePeriod=10 Jun 09 00:28:36.887096 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.887070 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:36.901972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.901950 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl"] Jun 09 00:28:36.902285 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.902274 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800d68e6-29d1-4371-9817-eafa3cd9cc0f" containerName="manager" Jun 09 00:28:36.902327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.902286 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="800d68e6-29d1-4371-9817-eafa3cd9cc0f" containerName="manager" Jun 09 00:28:36.902327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.902296 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" containerName="manager" Jun 09 00:28:36.902327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.902300 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" containerName="manager" Jun 09 00:28:36.902420 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.902371 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="760926fd-02b8-4a9a-bc3d-133ee902119d" containerName="manager" Jun 09 00:28:36.902420 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.902381 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="800d68e6-29d1-4371-9817-eafa3cd9cc0f" containerName="manager" Jun 09 00:28:36.905157 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.905142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:36.920754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:36.920731 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl"] Jun 09 00:28:37.009544 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.009520 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9gwt\" (UniqueName: \"kubernetes.io/projected/800d68e6-29d1-4371-9817-eafa3cd9cc0f-kube-api-access-j9gwt\") pod \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " Jun 09 00:28:37.009703 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.009688 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d68e6-29d1-4371-9817-eafa3cd9cc0f-extensions-socket-volume\") pod \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\" (UID: \"800d68e6-29d1-4371-9817-eafa3cd9cc0f\") " Jun 09 00:28:37.009802 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.009787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ntzl\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.009870 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.009840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlddq\" (UniqueName: \"kubernetes.io/projected/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-kube-api-access-tlddq\") pod \"kuadrant-operator-controller-manager-86878c769f-9ntzl\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.010040 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.010019 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/800d68e6-29d1-4371-9817-eafa3cd9cc0f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "800d68e6-29d1-4371-9817-eafa3cd9cc0f" (UID: "800d68e6-29d1-4371-9817-eafa3cd9cc0f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:28:37.011252 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.011231 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800d68e6-29d1-4371-9817-eafa3cd9cc0f-kube-api-access-j9gwt" (OuterVolumeSpecName: "kube-api-access-j9gwt") pod "800d68e6-29d1-4371-9817-eafa3cd9cc0f" (UID: "800d68e6-29d1-4371-9817-eafa3cd9cc0f"). InnerVolumeSpecName "kube-api-access-j9gwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:28:37.111300 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.111273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlddq\" (UniqueName: \"kubernetes.io/projected/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-kube-api-access-tlddq\") pod \"kuadrant-operator-controller-manager-86878c769f-9ntzl\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.111414 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.111397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ntzl\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.111484 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.111441 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d68e6-29d1-4371-9817-eafa3cd9cc0f-extensions-socket-volume\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:37.111484 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.111458 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9gwt\" (UniqueName: \"kubernetes.io/projected/800d68e6-29d1-4371-9817-eafa3cd9cc0f-kube-api-access-j9gwt\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:37.111753 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.111734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ntzl\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.119235 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.119184 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlddq\" (UniqueName: \"kubernetes.io/projected/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-kube-api-access-tlddq\") pod \"kuadrant-operator-controller-manager-86878c769f-9ntzl\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.214390 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.214367 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.345040 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.345012 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl"] Jun 09 00:28:37.346353 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:28:37.346333 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd403d024_1ae5_4aa6_9bba_8c9a9ec7caec.slice/crio-721557b67cb8ccaba1cffbec5942e16c170f2b168ad7db0ec46b42167b84682e WatchSource:0}: Error finding container 721557b67cb8ccaba1cffbec5942e16c170f2b168ad7db0ec46b42167b84682e: Status 404 returned error can't find the container with id 721557b67cb8ccaba1cffbec5942e16c170f2b168ad7db0ec46b42167b84682e Jun 09 00:28:37.660997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.660966 2572 generic.go:356] "Generic (PLEG): container finished" podID="800d68e6-29d1-4371-9817-eafa3cd9cc0f" containerID="67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47" exitCode=0 Jun 09 00:28:37.661389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.661008 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" Jun 09 00:28:37.661389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.661048 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" event={"ID":"800d68e6-29d1-4371-9817-eafa3cd9cc0f","Type":"ContainerDied","Data":"67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47"} Jun 09 00:28:37.661389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.661101 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c" event={"ID":"800d68e6-29d1-4371-9817-eafa3cd9cc0f","Type":"ContainerDied","Data":"295879bfaaf7721af0afa9915284d58c03440e2c710c36741f09a4cb6108b100"} Jun 09 00:28:37.661389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.661134 2572 scope.go:117] "RemoveContainer" containerID="67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47" Jun 09 00:28:37.662889 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.662864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" event={"ID":"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec","Type":"ContainerStarted","Data":"419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c"} Jun 09 00:28:37.663006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.662912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" event={"ID":"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec","Type":"ContainerStarted","Data":"721557b67cb8ccaba1cffbec5942e16c170f2b168ad7db0ec46b42167b84682e"} Jun 09 00:28:37.663006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.662973 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:37.673849 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.673834 2572 scope.go:117] "RemoveContainer" containerID="67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47" Jun 09 00:28:37.674070 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:37.674055 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47\": container with ID starting with 67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47 not found: ID does not exist" containerID="67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47" Jun 09 00:28:37.674119 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.674077 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47"} err="failed to get container status \"67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47\": rpc error: code = NotFound desc = could not find container \"67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47\": container with ID starting with 67189d6d4c969bac3951928d5300d0ec5e11809cf1f885879af194e10b842a47 not found: ID does not exist" Jun 09 00:28:37.684649 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.684610 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" podStartSLOduration=1.684598676 podStartE2EDuration="1.684598676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:37.682142139 +0000 UTC m=+529.729869575" watchObservedRunningTime="2026-06-09 00:28:37.684598676 +0000 UTC m=+529.732326111" Jun 09 00:28:37.699807 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.699781 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c"] Jun 09 00:28:37.705037 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:37.705016 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vqb2c"] Jun 09 00:28:38.390944 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:38.390898 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800d68e6-29d1-4371-9817-eafa3cd9cc0f" path="/var/lib/kubelet/pods/800d68e6-29d1-4371-9817-eafa3cd9cc0f/volumes" Jun 09 00:28:38.939608 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:38.939573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:39.028506 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:39.028481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:43.629788 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:43.629743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:43.730013 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:43.729979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:46.244424 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:46.244383 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:46.345367 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:46.345338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:48.670672 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:48.670647 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:28:48.732190 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:48.732163 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc"] Jun 09 00:28:48.732346 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:48.732327 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" podUID="8bc58a0e-98e4-4b02-8891-f668c970a7bc" containerName="manager" containerID="cri-o://3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f" gracePeriod=10 Jun 09 00:28:48.971062 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:48.971040 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:49.097591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.097544 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bc58a0e-98e4-4b02-8891-f668c970a7bc-extensions-socket-volume\") pod \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " Jun 09 00:28:49.097702 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.097647 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzw4f\" (UniqueName: \"kubernetes.io/projected/8bc58a0e-98e4-4b02-8891-f668c970a7bc-kube-api-access-mzw4f\") pod \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\" (UID: \"8bc58a0e-98e4-4b02-8891-f668c970a7bc\") " Jun 09 00:28:49.097900 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.097872 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc58a0e-98e4-4b02-8891-f668c970a7bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8bc58a0e-98e4-4b02-8891-f668c970a7bc" (UID: "8bc58a0e-98e4-4b02-8891-f668c970a7bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:28:49.099636 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.099611 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc58a0e-98e4-4b02-8891-f668c970a7bc-kube-api-access-mzw4f" (OuterVolumeSpecName: "kube-api-access-mzw4f") pod "8bc58a0e-98e4-4b02-8891-f668c970a7bc" (UID: "8bc58a0e-98e4-4b02-8891-f668c970a7bc"). InnerVolumeSpecName "kube-api-access-mzw4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:28:49.198645 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.198620 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzw4f\" (UniqueName: \"kubernetes.io/projected/8bc58a0e-98e4-4b02-8891-f668c970a7bc-kube-api-access-mzw4f\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:49.198645 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.198641 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bc58a0e-98e4-4b02-8891-f668c970a7bc-extensions-socket-volume\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:49.610691 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.610636 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-585995749-dn4rx" podUID="46893d8a-32ba-4c3e-806f-17764f5f04bf" containerName="console" containerID="cri-o://568d0b2731291f4ceac4549966c2171c6b757108d92e4f3c1bcd649d49c525c6" gracePeriod=15 Jun 09 00:28:49.728973 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.728950 2572 generic.go:356] "Generic (PLEG): container finished" podID="8bc58a0e-98e4-4b02-8891-f668c970a7bc" containerID="3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f" exitCode=0 Jun 09 00:28:49.729316 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.728988 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" Jun 09 00:28:49.729316 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.729040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" event={"ID":"8bc58a0e-98e4-4b02-8891-f668c970a7bc","Type":"ContainerDied","Data":"3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f"} Jun 09 00:28:49.729316 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.729107 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc" event={"ID":"8bc58a0e-98e4-4b02-8891-f668c970a7bc","Type":"ContainerDied","Data":"38535d24d400a7fad6596ee96fd2884d1d54035c9090518405bc387ec9e1e859"} Jun 09 00:28:49.729316 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.729141 2572 scope.go:117] "RemoveContainer" containerID="3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f" Jun 09 00:28:49.731113 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.731093 2572 generic.go:356] "Generic (PLEG): container finished" podID="46893d8a-32ba-4c3e-806f-17764f5f04bf" containerID="568d0b2731291f4ceac4549966c2171c6b757108d92e4f3c1bcd649d49c525c6" exitCode=0 Jun 09 00:28:49.731217 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.731173 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585995749-dn4rx" event={"ID":"46893d8a-32ba-4c3e-806f-17764f5f04bf","Type":"ContainerDied","Data":"568d0b2731291f4ceac4549966c2171c6b757108d92e4f3c1bcd649d49c525c6"} Jun 09 00:28:49.741932 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.741916 2572 scope.go:117] "RemoveContainer" containerID="3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f" Jun 09 00:28:49.742269 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:28:49.742242 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f\": container with ID starting with 3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f not found: ID does not exist" containerID="3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f" Jun 09 00:28:49.742353 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.742278 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f"} err="failed to get container status \"3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f\": rpc error: code = NotFound desc = could not find container \"3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f\": container with ID starting with 3358a0d04299654687792b475ae92193cae1cb69549213bf7aee4d714c3c9c5f not found: ID does not exist" Jun 09 00:28:49.757272 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.757248 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc"] Jun 09 00:28:49.765123 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.765103 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2zdjc"] Jun 09 00:28:49.848763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.848741 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:49.865231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.865185 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:28:49.956898 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:49.956875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:50.004433 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004414 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvpkf\" (UniqueName: \"kubernetes.io/projected/46893d8a-32ba-4c3e-806f-17764f5f04bf-kube-api-access-qvpkf\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004457 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-serving-cert\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004477 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-service-ca\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-trusted-ca-bundle\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004527 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-oauth-serving-cert\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004765 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004545 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-config\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004765 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004595 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-oauth-config\") pod \"46893d8a-32ba-4c3e-806f-17764f5f04bf\" (UID: \"46893d8a-32ba-4c3e-806f-17764f5f04bf\") " Jun 09 00:28:50.004974 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004950 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-service-ca" (OuterVolumeSpecName: "service-ca") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:28:50.004974 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004962 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:28:50.005103 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004970 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-config" (OuterVolumeSpecName: "console-config") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:28:50.005103 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.004991 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:28:50.006516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.006488 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:28:50.006627 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.006521 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46893d8a-32ba-4c3e-806f-17764f5f04bf-kube-api-access-qvpkf" (OuterVolumeSpecName: "kube-api-access-qvpkf") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "kube-api-access-qvpkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:28:50.006674 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.006625 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46893d8a-32ba-4c3e-806f-17764f5f04bf" (UID: "46893d8a-32ba-4c3e-806f-17764f5f04bf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:28:50.105896 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105875 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvpkf\" (UniqueName: \"kubernetes.io/projected/46893d8a-32ba-4c3e-806f-17764f5f04bf-kube-api-access-qvpkf\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.105896 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105894 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-serving-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.106007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105903 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-service-ca\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.106007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105912 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-trusted-ca-bundle\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.106007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105920 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-oauth-serving-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.106007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105929 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-config\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.106007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.105936 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46893d8a-32ba-4c3e-806f-17764f5f04bf-console-oauth-config\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:28:50.383362 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.383333 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc58a0e-98e4-4b02-8891-f668c970a7bc" path="/var/lib/kubelet/pods/8bc58a0e-98e4-4b02-8891-f668c970a7bc/volumes" Jun 09 00:28:50.739628 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.739601 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585995749-dn4rx" Jun 09 00:28:50.740026 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.739618 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585995749-dn4rx" event={"ID":"46893d8a-32ba-4c3e-806f-17764f5f04bf","Type":"ContainerDied","Data":"858a253e9fa69f98e50b2ca21623710f51aa0ed8e50129c88b1586c1519f961d"} Jun 09 00:28:50.740026 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.739682 2572 scope.go:117] "RemoveContainer" containerID="568d0b2731291f4ceac4549966c2171c6b757108d92e4f3c1bcd649d49c525c6" Jun 09 00:28:50.756548 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.756522 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585995749-dn4rx"] Jun 09 00:28:50.761754 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:50.761731 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-585995749-dn4rx"] Jun 09 00:28:52.368081 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:52.368045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:52.384060 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:52.384027 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46893d8a-32ba-4c3e-806f-17764f5f04bf" path="/var/lib/kubelet/pods/46893d8a-32ba-4c3e-806f-17764f5f04bf/volumes" Jun 09 00:28:53.390878 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.390802 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz"] Jun 09 00:28:53.391246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.391211 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46893d8a-32ba-4c3e-806f-17764f5f04bf" containerName="console" Jun 09 00:28:53.391246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.391224 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="46893d8a-32ba-4c3e-806f-17764f5f04bf" containerName="console" Jun 09 00:28:53.391246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.391239 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc58a0e-98e4-4b02-8891-f668c970a7bc" containerName="manager" Jun 09 00:28:53.391246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.391244 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc58a0e-98e4-4b02-8891-f668c970a7bc" containerName="manager" Jun 09 00:28:53.391376 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.391302 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="46893d8a-32ba-4c3e-806f-17764f5f04bf" containerName="console" Jun 09 00:28:53.391376 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.391312 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc58a0e-98e4-4b02-8891-f668c970a7bc" containerName="manager" Jun 09 00:28:53.395842 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.395822 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.398256 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.398229 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mfwr6\"" Jun 09 00:28:53.411602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.411547 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz"] Jun 09 00:28:53.434712 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.434686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:53.489164 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.489141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:53.533140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533233 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533430 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533430 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533430 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-956gx\" (UniqueName: \"kubernetes.io/projected/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-kube-api-access-956gx\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.533430 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.533404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634568 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634655 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634655 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634655 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634630 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634655 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-956gx\" (UniqueName: \"kubernetes.io/projected/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-kube-api-access-956gx\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634849 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634830 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634903 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634954 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.634954 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.635050 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.634969 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.635106 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.635058 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.635211 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.635190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.635499 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.635479 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.636852 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.636834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.637047 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.637031 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.642756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.642700 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.643063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.643043 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-956gx\" (UniqueName: \"kubernetes.io/projected/5c299396-1c5b-444a-bebf-d27a6f4b3ab2-kube-api-access-956gx\") pod \"maas-default-gateway-openshift-default-687ff6996-bfgsz\" (UID: \"5c299396-1c5b-444a-bebf-d27a6f4b3ab2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.706611 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.706589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:53.833476 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.833453 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz"] Jun 09 00:28:53.834885 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:28:53.834860 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c299396_1c5b_444a_bebf_d27a6f4b3ab2.slice/crio-cfc2890c502232ac90fd0205ff6068db9508ffd7d530b05a4269cb94423ab5e4 WatchSource:0}: Error finding container cfc2890c502232ac90fd0205ff6068db9508ffd7d530b05a4269cb94423ab5e4: Status 404 returned error can't find the container with id cfc2890c502232ac90fd0205ff6068db9508ffd7d530b05a4269cb94423ab5e4 Jun 09 00:28:53.836796 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.836762 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:28:53.836855 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.836829 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:28:53.836898 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:53.836862 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:28:54.765450 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:54.765402 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" event={"ID":"5c299396-1c5b-444a-bebf-d27a6f4b3ab2","Type":"ContainerStarted","Data":"8d60bc2e2b345c0f339226e175653bcada3db1fb330f27bddc5d8b9fba86e13e"} Jun 09 00:28:54.765864 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:54.765472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" event={"ID":"5c299396-1c5b-444a-bebf-d27a6f4b3ab2","Type":"ContainerStarted","Data":"cfc2890c502232ac90fd0205ff6068db9508ffd7d530b05a4269cb94423ab5e4"} Jun 09 00:28:54.787590 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:54.787522 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" podStartSLOduration=1.787506011 podStartE2EDuration="1.787506011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:28:54.785532935 +0000 UTC m=+546.833260370" watchObservedRunningTime="2026-06-09 00:28:54.787506011 +0000 UTC m=+546.835233447" Jun 09 00:28:55.706790 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:55.706759 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:55.711538 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:55.711513 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:55.771386 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:55.771357 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:55.772075 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:55.772057 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:28:56.566640 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:56.566616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:58.248065 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:58.248025 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:28:58.351592 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:28:58.351545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:03.047141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:03.047106 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:03.145793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:03.145766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:03.203869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:03.203840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:08.085372 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.085344 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:08.086833 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.086811 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:08.090520 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.090507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.092781 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.092762 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 00:29:08.092898 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.092814 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bhwc\"" Jun 09 00:29:08.099752 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.099729 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:08.184327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.184301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:08.186505 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.186480 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:08.247108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.247083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxhr\" (UniqueName: \"kubernetes.io/projected/888419ca-b697-475c-9376-fce5871c0d29-kube-api-access-nzxhr\") pod \"limitador-limitador-64c94fd64f-s922q\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.247221 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.247115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/888419ca-b697-475c-9376-fce5871c0d29-config-file\") pod \"limitador-limitador-64c94fd64f-s922q\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.286536 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.286478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:08.348340 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.348281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxhr\" (UniqueName: \"kubernetes.io/projected/888419ca-b697-475c-9376-fce5871c0d29-kube-api-access-nzxhr\") pod \"limitador-limitador-64c94fd64f-s922q\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.348340 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.348312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/888419ca-b697-475c-9376-fce5871c0d29-config-file\") pod \"limitador-limitador-64c94fd64f-s922q\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.348838 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.348823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/888419ca-b697-475c-9376-fce5871c0d29-config-file\") pod \"limitador-limitador-64c94fd64f-s922q\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.355516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.355493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxhr\" (UniqueName: \"kubernetes.io/projected/888419ca-b697-475c-9376-fce5871c0d29-kube-api-access-nzxhr\") pod \"limitador-limitador-64c94fd64f-s922q\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.401457 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.401433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:08.547117 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.547095 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:08.549227 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:29:08.549199 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888419ca_b697_475c_9376_fce5871c0d29.slice/crio-98f8523c8a3c6a7f1f5e06980c30a4ad4fbe70d0c74d15be552f670cd885e5ba WatchSource:0}: Error finding container 98f8523c8a3c6a7f1f5e06980c30a4ad4fbe70d0c74d15be552f670cd885e5ba: Status 404 returned error can't find the container with id 98f8523c8a3c6a7f1f5e06980c30a4ad4fbe70d0c74d15be552f670cd885e5ba Jun 09 00:29:08.841742 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.841716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" event={"ID":"888419ca-b697-475c-9376-fce5871c0d29","Type":"ContainerStarted","Data":"98f8523c8a3c6a7f1f5e06980c30a4ad4fbe70d0c74d15be552f670cd885e5ba"} Jun 09 00:29:08.877304 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.877281 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-k6svn"] Jun 09 00:29:08.881763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.881747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:08.884337 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.884313 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z2z48\"" Jun 09 00:29:08.890540 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.890520 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k6svn"] Jun 09 00:29:08.911725 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.911699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:08.980351 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:08.980332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:09.055112 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.055088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmtwz\" (UniqueName: \"kubernetes.io/projected/25d1e32e-8521-421c-a1c1-1bdfa10697b1-kube-api-access-nmtwz\") pod \"authorino-58cd955675-k6svn\" (UID: \"25d1e32e-8521-421c-a1c1-1bdfa10697b1\") " pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:09.075177 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.075157 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ntpg"] Jun 09 00:29:09.078363 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.078347 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:29:09.087244 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.087221 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ntpg"] Jun 09 00:29:09.155746 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.155726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmtwz\" (UniqueName: \"kubernetes.io/projected/25d1e32e-8521-421c-a1c1-1bdfa10697b1-kube-api-access-nmtwz\") pod \"authorino-58cd955675-k6svn\" (UID: \"25d1e32e-8521-421c-a1c1-1bdfa10697b1\") " pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:09.155859 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.155785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkt4\" (UniqueName: \"kubernetes.io/projected/bffcf440-e150-451f-83c9-685e1fdaf1e5-kube-api-access-knkt4\") pod \"authorino-75d556bd77-6ntpg\" (UID: \"bffcf440-e150-451f-83c9-685e1fdaf1e5\") " pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:29:09.164201 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.164171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmtwz\" (UniqueName: \"kubernetes.io/projected/25d1e32e-8521-421c-a1c1-1bdfa10697b1-kube-api-access-nmtwz\") pod \"authorino-58cd955675-k6svn\" (UID: \"25d1e32e-8521-421c-a1c1-1bdfa10697b1\") " pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:09.191025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.191002 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:09.260905 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.259404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knkt4\" (UniqueName: \"kubernetes.io/projected/bffcf440-e150-451f-83c9-685e1fdaf1e5-kube-api-access-knkt4\") pod \"authorino-75d556bd77-6ntpg\" (UID: \"bffcf440-e150-451f-83c9-685e1fdaf1e5\") " pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:29:09.269740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.269639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkt4\" (UniqueName: \"kubernetes.io/projected/bffcf440-e150-451f-83c9-685e1fdaf1e5-kube-api-access-knkt4\") pod \"authorino-75d556bd77-6ntpg\" (UID: \"bffcf440-e150-451f-83c9-685e1fdaf1e5\") " pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:29:09.362166 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:29:09.361695 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25d1e32e_8521_421c_a1c1_1bdfa10697b1.slice/crio-5d391837e10b4e2abb6725bac2e1aeaefa50c26fe7a02b7d79effa77269710b4 WatchSource:0}: Error finding container 5d391837e10b4e2abb6725bac2e1aeaefa50c26fe7a02b7d79effa77269710b4: Status 404 returned error can't find the container with id 5d391837e10b4e2abb6725bac2e1aeaefa50c26fe7a02b7d79effa77269710b4 Jun 09 00:29:09.365167 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.365137 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k6svn"] Jun 09 00:29:09.386179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.386114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:29:09.562876 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.562843 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ntpg"] Jun 09 00:29:09.564568 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:29:09.564518 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbffcf440_e150_451f_83c9_685e1fdaf1e5.slice/crio-e2c8566912197cbb6e38afafc1468653742636adec62c7b6dff1ed54020def28 WatchSource:0}: Error finding container e2c8566912197cbb6e38afafc1468653742636adec62c7b6dff1ed54020def28: Status 404 returned error can't find the container with id e2c8566912197cbb6e38afafc1468653742636adec62c7b6dff1ed54020def28 Jun 09 00:29:09.848481 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.848410 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ntpg" event={"ID":"bffcf440-e150-451f-83c9-685e1fdaf1e5","Type":"ContainerStarted","Data":"e2c8566912197cbb6e38afafc1468653742636adec62c7b6dff1ed54020def28"} Jun 09 00:29:09.849701 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:09.849675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k6svn" event={"ID":"25d1e32e-8521-421c-a1c1-1bdfa10697b1","Type":"ContainerStarted","Data":"5d391837e10b4e2abb6725bac2e1aeaefa50c26fe7a02b7d79effa77269710b4"} Jun 09 00:29:13.875589 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.875529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ntpg" event={"ID":"bffcf440-e150-451f-83c9-685e1fdaf1e5","Type":"ContainerStarted","Data":"e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59"} Jun 09 00:29:13.877161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.877127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k6svn" event={"ID":"25d1e32e-8521-421c-a1c1-1bdfa10697b1","Type":"ContainerStarted","Data":"3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507"} Jun 09 00:29:13.878956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.878928 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" event={"ID":"888419ca-b697-475c-9376-fce5871c0d29","Type":"ContainerStarted","Data":"47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa"} Jun 09 00:29:13.879105 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.879022 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:13.891309 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.891261 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6ntpg" podStartSLOduration=1.4001840159999999 podStartE2EDuration="4.891247761s" totalImagesPullingTime="3.491063745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:29:13.890446396 +0000 UTC m=+565.938173832" watchObservedRunningTime="2026-06-09 00:29:13.891247761 +0000 UTC m=+565.938975196" Jun 09 00:29:13.913642 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.913592 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" podStartSLOduration=1.475779798 podStartE2EDuration="5.913547576s" totalImagesPullingTime="4.437767778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:29:13.912811865 +0000 UTC m=+565.960539301" watchObservedRunningTime="2026-06-09 00:29:13.913547576 +0000 UTC m=+565.961275011" Jun 09 00:29:13.917847 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.917822 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k6svn"] Jun 09 00:29:13.927346 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:13.927304 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-k6svn" podStartSLOduration=2.235053952 podStartE2EDuration="5.9272924s" totalImagesPullingTime="3.692238448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:29:13.92705423 +0000 UTC m=+565.974781665" watchObservedRunningTime="2026-06-09 00:29:13.9272924 +0000 UTC m=+565.975019835" Jun 09 00:29:15.889988 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:15.889944 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-k6svn" podUID="25d1e32e-8521-421c-a1c1-1bdfa10697b1" containerName="authorino" containerID="cri-o://3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507" gracePeriod=30 Jun 09 00:29:16.128295 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.128274 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:16.223857 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.223803 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmtwz\" (UniqueName: \"kubernetes.io/projected/25d1e32e-8521-421c-a1c1-1bdfa10697b1-kube-api-access-nmtwz\") pod \"25d1e32e-8521-421c-a1c1-1bdfa10697b1\" (UID: \"25d1e32e-8521-421c-a1c1-1bdfa10697b1\") " Jun 09 00:29:16.225676 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.225646 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d1e32e-8521-421c-a1c1-1bdfa10697b1-kube-api-access-nmtwz" (OuterVolumeSpecName: "kube-api-access-nmtwz") pod "25d1e32e-8521-421c-a1c1-1bdfa10697b1" (UID: "25d1e32e-8521-421c-a1c1-1bdfa10697b1"). InnerVolumeSpecName "kube-api-access-nmtwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:29:16.324277 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.324255 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmtwz\" (UniqueName: \"kubernetes.io/projected/25d1e32e-8521-421c-a1c1-1bdfa10697b1-kube-api-access-nmtwz\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:29:16.896639 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.896602 2572 generic.go:356] "Generic (PLEG): container finished" podID="25d1e32e-8521-421c-a1c1-1bdfa10697b1" containerID="3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507" exitCode=0 Jun 09 00:29:16.896953 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.896649 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k6svn" Jun 09 00:29:16.896953 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.896698 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k6svn" event={"ID":"25d1e32e-8521-421c-a1c1-1bdfa10697b1","Type":"ContainerDied","Data":"3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507"} Jun 09 00:29:16.896953 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.896739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k6svn" event={"ID":"25d1e32e-8521-421c-a1c1-1bdfa10697b1","Type":"ContainerDied","Data":"5d391837e10b4e2abb6725bac2e1aeaefa50c26fe7a02b7d79effa77269710b4"} Jun 09 00:29:16.896953 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.896755 2572 scope.go:117] "RemoveContainer" containerID="3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507" Jun 09 00:29:16.906176 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.906158 2572 scope.go:117] "RemoveContainer" containerID="3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507" Jun 09 00:29:16.906442 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:29:16.906423 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507\": container with ID starting with 3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507 not found: ID does not exist" containerID="3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507" Jun 09 00:29:16.906482 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.906451 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507"} err="failed to get container status \"3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507\": rpc error: code = NotFound desc = could not find container \"3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507\": container with ID starting with 3c0382ab9d27a036cd5c709b0a042e8f04dd4169147a67e0ebf0accc49f49507 not found: ID does not exist" Jun 09 00:29:16.912101 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.912076 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k6svn"] Jun 09 00:29:16.915785 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:16.915761 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-k6svn"] Jun 09 00:29:18.383100 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:18.383067 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d1e32e-8521-421c-a1c1-1bdfa10697b1" path="/var/lib/kubelet/pods/25d1e32e-8521-421c-a1c1-1bdfa10697b1/volumes" Jun 09 00:29:23.012631 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.012593 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:23.013082 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.012775 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" podUID="888419ca-b697-475c-9376-fce5871c0d29" containerName="limitador" containerID="cri-o://47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa" gracePeriod=30 Jun 09 00:29:23.013459 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.013396 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:23.562469 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.562447 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:23.681846 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.681811 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/888419ca-b697-475c-9376-fce5871c0d29-config-file\") pod \"888419ca-b697-475c-9376-fce5871c0d29\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " Jun 09 00:29:23.681973 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.681901 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzxhr\" (UniqueName: \"kubernetes.io/projected/888419ca-b697-475c-9376-fce5871c0d29-kube-api-access-nzxhr\") pod \"888419ca-b697-475c-9376-fce5871c0d29\" (UID: \"888419ca-b697-475c-9376-fce5871c0d29\") " Jun 09 00:29:23.682134 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.682112 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/888419ca-b697-475c-9376-fce5871c0d29-config-file" (OuterVolumeSpecName: "config-file") pod "888419ca-b697-475c-9376-fce5871c0d29" (UID: "888419ca-b697-475c-9376-fce5871c0d29"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:29:23.684006 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.683977 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888419ca-b697-475c-9376-fce5871c0d29-kube-api-access-nzxhr" (OuterVolumeSpecName: "kube-api-access-nzxhr") pod "888419ca-b697-475c-9376-fce5871c0d29" (UID: "888419ca-b697-475c-9376-fce5871c0d29"). InnerVolumeSpecName "kube-api-access-nzxhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:29:23.783122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.783090 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzxhr\" (UniqueName: \"kubernetes.io/projected/888419ca-b697-475c-9376-fce5871c0d29-kube-api-access-nzxhr\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:29:23.783122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.783121 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/888419ca-b697-475c-9376-fce5871c0d29-config-file\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:29:23.938750 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.938678 2572 generic.go:356] "Generic (PLEG): container finished" podID="888419ca-b697-475c-9376-fce5871c0d29" containerID="47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa" exitCode=0 Jun 09 00:29:23.938750 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.938729 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" Jun 09 00:29:23.938872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.938764 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" event={"ID":"888419ca-b697-475c-9376-fce5871c0d29","Type":"ContainerDied","Data":"47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa"} Jun 09 00:29:23.938872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.938826 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s922q" event={"ID":"888419ca-b697-475c-9376-fce5871c0d29","Type":"ContainerDied","Data":"98f8523c8a3c6a7f1f5e06980c30a4ad4fbe70d0c74d15be552f670cd885e5ba"} Jun 09 00:29:23.938872 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.938850 2572 scope.go:117] "RemoveContainer" containerID="47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa" Jun 09 00:29:23.948665 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.948638 2572 scope.go:117] "RemoveContainer" containerID="47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa" Jun 09 00:29:23.948912 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:29:23.948895 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa\": container with ID starting with 47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa not found: ID does not exist" containerID="47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa" Jun 09 00:29:23.948968 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.948919 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa"} err="failed to get container status \"47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa\": rpc error: code = NotFound desc = could not find container \"47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa\": container with ID starting with 47580c5dba56cce356f33d00f85371442ef138b0e55bde2787d0cb68eaf847fa not found: ID does not exist" Jun 09 00:29:23.960382 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.960351 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:23.962348 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:23.962323 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s922q"] Jun 09 00:29:24.384304 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:24.384240 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888419ca-b697-475c-9376-fce5871c0d29" path="/var/lib/kubelet/pods/888419ca-b697-475c-9376-fce5871c0d29/volumes" Jun 09 00:29:28.465972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.465937 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:28.565407 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.565379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:28.887319 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887285 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-775q4"] Jun 09 00:29:28.887707 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887691 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888419ca-b697-475c-9376-fce5871c0d29" containerName="limitador" Jun 09 00:29:28.887707 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887709 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="888419ca-b697-475c-9376-fce5871c0d29" containerName="limitador" Jun 09 00:29:28.887795 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887736 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d1e32e-8521-421c-a1c1-1bdfa10697b1" containerName="authorino" Jun 09 00:29:28.887795 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887742 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d1e32e-8521-421c-a1c1-1bdfa10697b1" containerName="authorino" Jun 09 00:29:28.887795 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887793 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="888419ca-b697-475c-9376-fce5871c0d29" containerName="limitador" Jun 09 00:29:28.887891 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.887802 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d1e32e-8521-421c-a1c1-1bdfa10697b1" containerName="authorino" Jun 09 00:29:28.890792 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.890774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:28.893401 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.893378 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 00:29:28.893495 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.893378 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 00:29:28.894546 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.894524 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-zxpz7\"" Jun 09 00:29:28.894731 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.894599 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 09 00:29:28.900663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.900639 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-775q4"] Jun 09 00:29:28.919332 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.919307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4zw2\" (UniqueName: \"kubernetes.io/projected/db280cec-5e14-4736-8b8b-9133865f9db3-kube-api-access-h4zw2\") pod \"postgres-69fb4594cf-775q4\" (UID: \"db280cec-5e14-4736-8b8b-9133865f9db3\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:28.919420 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.919366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db280cec-5e14-4736-8b8b-9133865f9db3-data\") pod \"postgres-69fb4594cf-775q4\" (UID: \"db280cec-5e14-4736-8b8b-9133865f9db3\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:28.926569 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:28.926530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:29.020178 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.020157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db280cec-5e14-4736-8b8b-9133865f9db3-data\") pod \"postgres-69fb4594cf-775q4\" (UID: \"db280cec-5e14-4736-8b8b-9133865f9db3\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:29.020268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.020214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4zw2\" (UniqueName: \"kubernetes.io/projected/db280cec-5e14-4736-8b8b-9133865f9db3-kube-api-access-h4zw2\") pod \"postgres-69fb4594cf-775q4\" (UID: \"db280cec-5e14-4736-8b8b-9133865f9db3\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:29.020506 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.020490 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db280cec-5e14-4736-8b8b-9133865f9db3-data\") pod \"postgres-69fb4594cf-775q4\" (UID: \"db280cec-5e14-4736-8b8b-9133865f9db3\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:29.030022 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.029998 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4zw2\" (UniqueName: \"kubernetes.io/projected/db280cec-5e14-4736-8b8b-9133865f9db3-kube-api-access-h4zw2\") pod \"postgres-69fb4594cf-775q4\" (UID: \"db280cec-5e14-4736-8b8b-9133865f9db3\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:29.202323 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.202294 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:29.325690 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.325664 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-775q4"] Jun 09 00:29:29.327069 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:29:29.327043 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb280cec_5e14_4736_8b8b_9133865f9db3.slice/crio-64107acaf5009ed4f2603ed51e7cd653651350e0600090e4d962c8c3f8778fc4 WatchSource:0}: Error finding container 64107acaf5009ed4f2603ed51e7cd653651350e0600090e4d962c8c3f8778fc4: Status 404 returned error can't find the container with id 64107acaf5009ed4f2603ed51e7cd653651350e0600090e4d962c8c3f8778fc4 Jun 09 00:29:29.975707 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:29.975668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" event={"ID":"db280cec-5e14-4736-8b8b-9133865f9db3","Type":"ContainerStarted","Data":"64107acaf5009ed4f2603ed51e7cd653651350e0600090e4d962c8c3f8778fc4"} Jun 09 00:29:32.995437 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:32.995361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" event={"ID":"db280cec-5e14-4736-8b8b-9133865f9db3","Type":"ContainerStarted","Data":"e687006ff52a4dab9721b81fe78930d3e1528be37849fe158aa47d16544277a3"} Jun 09 00:29:32.995824 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:32.995488 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:33.013583 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:33.013520 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" podStartSLOduration=1.645471847 podStartE2EDuration="5.013506423s" totalImagesPullingTime="3.368034576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:29:33.011595626 +0000 UTC m=+585.059323058" watchObservedRunningTime="2026-06-09 00:29:33.013506423 +0000 UTC m=+585.061233858" Jun 09 00:29:39.034644 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:39.034615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-775q4" Jun 09 00:29:39.345542 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:39.345435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:39.451760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:39.451730 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:39.611575 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:39.611462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:29:47.766230 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.766187 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-ntcxv"] Jun 09 00:29:47.777080 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.777052 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" Jun 09 00:29:47.778336 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.778306 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-ntcxv"] Jun 09 00:29:47.779853 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.779822 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 00:29:47.780179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.780153 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 00:29:47.780843 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.780824 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-htv9t\"" Jun 09 00:29:47.863817 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.863788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfv2r\" (UniqueName: \"kubernetes.io/projected/640a1c4f-ab90-4065-b2d2-328cc685497b-kube-api-access-vfv2r\") pod \"keycloak-operator-d67dbbb48-ntcxv\" (UID: \"640a1c4f-ab90-4065-b2d2-328cc685497b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" Jun 09 00:29:47.965043 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.965016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfv2r\" (UniqueName: \"kubernetes.io/projected/640a1c4f-ab90-4065-b2d2-328cc685497b-kube-api-access-vfv2r\") pod \"keycloak-operator-d67dbbb48-ntcxv\" (UID: \"640a1c4f-ab90-4065-b2d2-328cc685497b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" Jun 09 00:29:47.973604 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:47.973584 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfv2r\" (UniqueName: \"kubernetes.io/projected/640a1c4f-ab90-4065-b2d2-328cc685497b-kube-api-access-vfv2r\") pod \"keycloak-operator-d67dbbb48-ntcxv\" (UID: \"640a1c4f-ab90-4065-b2d2-328cc685497b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" Jun 09 00:29:48.088756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:48.088695 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" Jun 09 00:29:48.217943 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:48.217921 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-ntcxv"] Jun 09 00:29:48.219021 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:29:48.218991 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640a1c4f_ab90_4065_b2d2_328cc685497b.slice/crio-dd683a9f9eaee214f2117ff1c7431ed3f892a43f71318953544beeaf0576b42c WatchSource:0}: Error finding container dd683a9f9eaee214f2117ff1c7431ed3f892a43f71318953544beeaf0576b42c: Status 404 returned error can't find the container with id dd683a9f9eaee214f2117ff1c7431ed3f892a43f71318953544beeaf0576b42c Jun 09 00:29:48.366410 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:48.366359 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:29:48.366668 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:48.366651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:29:48.370534 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:48.370516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:29:48.370751 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:48.370737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:29:49.084248 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:49.084209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" event={"ID":"640a1c4f-ab90-4065-b2d2-328cc685497b","Type":"ContainerStarted","Data":"dd683a9f9eaee214f2117ff1c7431ed3f892a43f71318953544beeaf0576b42c"} Jun 09 00:29:54.115410 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:54.115326 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" event={"ID":"640a1c4f-ab90-4065-b2d2-328cc685497b","Type":"ContainerStarted","Data":"79840e95704125c00da81f0467f51763006d6184f8f9c980d6bafdec1364b61e"} Jun 09 00:29:54.132717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:29:54.132673 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-ntcxv" podStartSLOduration=1.5321197020000001 podStartE2EDuration="7.13265834s" totalImagesPullingTime="5.600538638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:29:54.132060811 +0000 UTC m=+606.179788248" watchObservedRunningTime="2026-06-09 00:29:54.13265834 +0000 UTC m=+606.180385776" Jun 09 00:30:01.710244 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:01.710151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:01.760931 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:01.760899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:33.219077 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.219044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:33.445883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.445856 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tgvqs"] Jun 09 00:30:33.454276 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.454241 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:33.457691 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.457655 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tgvqs"] Jun 09 00:30:33.635437 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.635370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pl57\" (UniqueName: \"kubernetes.io/projected/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8-kube-api-access-6pl57\") pod \"authorino-5d4b67c446-tgvqs\" (UID: \"20ba134e-c8f4-4d8b-98ed-fd6f6da269b8\") " pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:33.667785 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.667756 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tgvqs"] Jun 09 00:30:33.667944 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:30:33.667923 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6pl57], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-tgvqs" podUID="20ba134e-c8f4-4d8b-98ed-fd6f6da269b8" Jun 09 00:30:33.693163 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.693137 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68d769866f-s5cdq"] Jun 09 00:30:33.695499 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.695482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:33.702538 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.702519 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68d769866f-s5cdq"] Jun 09 00:30:33.736706 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.736683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pl57\" (UniqueName: \"kubernetes.io/projected/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8-kube-api-access-6pl57\") pod \"authorino-5d4b67c446-tgvqs\" (UID: \"20ba134e-c8f4-4d8b-98ed-fd6f6da269b8\") " pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:33.744820 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.744805 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pl57\" (UniqueName: \"kubernetes.io/projected/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8-kube-api-access-6pl57\") pod \"authorino-5d4b67c446-tgvqs\" (UID: \"20ba134e-c8f4-4d8b-98ed-fd6f6da269b8\") " pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:33.838033 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.838009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mwbs\" (UniqueName: \"kubernetes.io/projected/93aae473-bc23-4527-94c3-8d264b2f60a1-kube-api-access-8mwbs\") pod \"authorino-68d769866f-s5cdq\" (UID: \"93aae473-bc23-4527-94c3-8d264b2f60a1\") " pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:33.873019 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.872995 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68d769866f-s5cdq"] Jun 09 00:30:33.873166 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:30:33.873148 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8mwbs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-68d769866f-s5cdq" podUID="93aae473-bc23-4527-94c3-8d264b2f60a1" Jun 09 00:30:33.896946 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.896928 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b877d7997-mzhbg"] Jun 09 00:30:33.899093 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.899079 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:33.901076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.901058 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 00:30:33.909236 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.909217 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b877d7997-mzhbg"] Jun 09 00:30:33.939080 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.939053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mwbs\" (UniqueName: \"kubernetes.io/projected/93aae473-bc23-4527-94c3-8d264b2f60a1-kube-api-access-8mwbs\") pod \"authorino-68d769866f-s5cdq\" (UID: \"93aae473-bc23-4527-94c3-8d264b2f60a1\") " pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:33.939179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.939100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knsw5\" (UniqueName: \"kubernetes.io/projected/3c1658f9-64c2-49fc-8e27-a1a3625119bb-kube-api-access-knsw5\") pod \"authorino-b877d7997-mzhbg\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:33.939179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.939130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c1658f9-64c2-49fc-8e27-a1a3625119bb-tls-cert\") pod \"authorino-b877d7997-mzhbg\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:33.946247 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:33.946228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mwbs\" (UniqueName: \"kubernetes.io/projected/93aae473-bc23-4527-94c3-8d264b2f60a1-kube-api-access-8mwbs\") pod \"authorino-68d769866f-s5cdq\" (UID: \"93aae473-bc23-4527-94c3-8d264b2f60a1\") " pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:34.040274 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.040252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knsw5\" (UniqueName: \"kubernetes.io/projected/3c1658f9-64c2-49fc-8e27-a1a3625119bb-kube-api-access-knsw5\") pod \"authorino-b877d7997-mzhbg\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:34.040389 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.040281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c1658f9-64c2-49fc-8e27-a1a3625119bb-tls-cert\") pod \"authorino-b877d7997-mzhbg\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:34.042336 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.042318 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c1658f9-64c2-49fc-8e27-a1a3625119bb-tls-cert\") pod \"authorino-b877d7997-mzhbg\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:34.047642 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.047623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knsw5\" (UniqueName: \"kubernetes.io/projected/3c1658f9-64c2-49fc-8e27-a1a3625119bb-kube-api-access-knsw5\") pod \"authorino-b877d7997-mzhbg\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:34.207573 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.207508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:30:34.330573 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.330529 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b877d7997-mzhbg"] Jun 09 00:30:34.332080 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:30:34.332058 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c1658f9_64c2_49fc_8e27_a1a3625119bb.slice/crio-2b2a5ab15bd0cceeb0c538b12b69af8e2a9a857da4e46ba8e315ee3ebf11b9ab WatchSource:0}: Error finding container 2b2a5ab15bd0cceeb0c538b12b69af8e2a9a857da4e46ba8e315ee3ebf11b9ab: Status 404 returned error can't find the container with id 2b2a5ab15bd0cceeb0c538b12b69af8e2a9a857da4e46ba8e315ee3ebf11b9ab Jun 09 00:30:34.333322 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.333306 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:30:34.335360 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.335343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:34.335444 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.335343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:34.342080 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.342062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:34.344708 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.344691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:34.442535 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.442516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pl57\" (UniqueName: \"kubernetes.io/projected/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8-kube-api-access-6pl57\") pod \"20ba134e-c8f4-4d8b-98ed-fd6f6da269b8\" (UID: \"20ba134e-c8f4-4d8b-98ed-fd6f6da269b8\") " Jun 09 00:30:34.444351 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.444321 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8-kube-api-access-6pl57" (OuterVolumeSpecName: "kube-api-access-6pl57") pod "20ba134e-c8f4-4d8b-98ed-fd6f6da269b8" (UID: "20ba134e-c8f4-4d8b-98ed-fd6f6da269b8"). InnerVolumeSpecName "kube-api-access-6pl57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:30:34.460989 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.460936 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:34.543063 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.543030 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mwbs\" (UniqueName: \"kubernetes.io/projected/93aae473-bc23-4527-94c3-8d264b2f60a1-kube-api-access-8mwbs\") pod \"93aae473-bc23-4527-94c3-8d264b2f60a1\" (UID: \"93aae473-bc23-4527-94c3-8d264b2f60a1\") " Jun 09 00:30:34.543183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.543170 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pl57\" (UniqueName: \"kubernetes.io/projected/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8-kube-api-access-6pl57\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:30:34.544851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.544830 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93aae473-bc23-4527-94c3-8d264b2f60a1-kube-api-access-8mwbs" (OuterVolumeSpecName: "kube-api-access-8mwbs") pod "93aae473-bc23-4527-94c3-8d264b2f60a1" (UID: "93aae473-bc23-4527-94c3-8d264b2f60a1"). InnerVolumeSpecName "kube-api-access-8mwbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:30:34.643977 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:34.643958 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mwbs\" (UniqueName: \"kubernetes.io/projected/93aae473-bc23-4527-94c3-8d264b2f60a1-kube-api-access-8mwbs\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:30:35.343126 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.343088 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b877d7997-mzhbg" event={"ID":"3c1658f9-64c2-49fc-8e27-a1a3625119bb","Type":"ContainerStarted","Data":"c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63"} Jun 09 00:30:35.343480 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.343128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d769866f-s5cdq" Jun 09 00:30:35.343480 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.343136 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b877d7997-mzhbg" event={"ID":"3c1658f9-64c2-49fc-8e27-a1a3625119bb","Type":"ContainerStarted","Data":"2b2a5ab15bd0cceeb0c538b12b69af8e2a9a857da4e46ba8e315ee3ebf11b9ab"} Jun 09 00:30:35.343480 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.343401 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tgvqs" Jun 09 00:30:35.357863 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.357816 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b877d7997-mzhbg" podStartSLOduration=2.037765861 podStartE2EDuration="2.357800058s" totalImagesPullingTime="320.034197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:30:35.356934286 +0000 UTC m=+647.404661721" watchObservedRunningTime="2026-06-09 00:30:35.357800058 +0000 UTC m=+647.405527493" Jun 09 00:30:35.389765 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.389739 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68d769866f-s5cdq"] Jun 09 00:30:35.393310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.393286 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ntpg"] Jun 09 00:30:35.393537 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.393466 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6ntpg" podUID="bffcf440-e150-451f-83c9-685e1fdaf1e5" containerName="authorino" containerID="cri-o://e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59" gracePeriod=30 Jun 09 00:30:35.396647 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.396466 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68d769866f-s5cdq"] Jun 09 00:30:35.417137 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.417108 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tgvqs"] Jun 09 00:30:35.420654 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.420626 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tgvqs"] Jun 09 00:30:35.629379 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.629353 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:30:35.651669 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.651648 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knkt4\" (UniqueName: \"kubernetes.io/projected/bffcf440-e150-451f-83c9-685e1fdaf1e5-kube-api-access-knkt4\") pod \"bffcf440-e150-451f-83c9-685e1fdaf1e5\" (UID: \"bffcf440-e150-451f-83c9-685e1fdaf1e5\") " Jun 09 00:30:35.653504 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.653472 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bffcf440-e150-451f-83c9-685e1fdaf1e5-kube-api-access-knkt4" (OuterVolumeSpecName: "kube-api-access-knkt4") pod "bffcf440-e150-451f-83c9-685e1fdaf1e5" (UID: "bffcf440-e150-451f-83c9-685e1fdaf1e5"). InnerVolumeSpecName "kube-api-access-knkt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:30:35.752381 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:35.752361 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knkt4\" (UniqueName: \"kubernetes.io/projected/bffcf440-e150-451f-83c9-685e1fdaf1e5-kube-api-access-knkt4\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:30:36.350025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.349997 2572 generic.go:356] "Generic (PLEG): container finished" podID="bffcf440-e150-451f-83c9-685e1fdaf1e5" containerID="e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59" exitCode=0 Jun 09 00:30:36.350025 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.350038 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ntpg" Jun 09 00:30:36.350489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.350132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ntpg" event={"ID":"bffcf440-e150-451f-83c9-685e1fdaf1e5","Type":"ContainerDied","Data":"e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59"} Jun 09 00:30:36.350489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.350182 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ntpg" event={"ID":"bffcf440-e150-451f-83c9-685e1fdaf1e5","Type":"ContainerDied","Data":"e2c8566912197cbb6e38afafc1468653742636adec62c7b6dff1ed54020def28"} Jun 09 00:30:36.350489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.350208 2572 scope.go:117] "RemoveContainer" containerID="e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59" Jun 09 00:30:36.360375 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.360345 2572 scope.go:117] "RemoveContainer" containerID="e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59" Jun 09 00:30:36.360809 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:30:36.360779 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59\": container with ID starting with e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59 not found: ID does not exist" containerID="e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59" Jun 09 00:30:36.360914 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.360816 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59"} err="failed to get container status \"e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59\": rpc error: code = NotFound desc = could not find container \"e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59\": container with ID starting with e3161f17ea6c41e8884b47d638c597377bef952b4ba33aa70ef100d1862eca59 not found: ID does not exist" Jun 09 00:30:36.369745 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.369724 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ntpg"] Jun 09 00:30:36.373197 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.373178 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ntpg"] Jun 09 00:30:36.382447 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.382422 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ba134e-c8f4-4d8b-98ed-fd6f6da269b8" path="/var/lib/kubelet/pods/20ba134e-c8f4-4d8b-98ed-fd6f6da269b8/volumes" Jun 09 00:30:36.382710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.382692 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93aae473-bc23-4527-94c3-8d264b2f60a1" path="/var/lib/kubelet/pods/93aae473-bc23-4527-94c3-8d264b2f60a1/volumes" Jun 09 00:30:36.382940 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:36.382924 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bffcf440-e150-451f-83c9-685e1fdaf1e5" path="/var/lib/kubelet/pods/bffcf440-e150-451f-83c9-685e1fdaf1e5/volumes" Jun 09 00:30:38.885858 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:38.885826 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:39.042070 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:39.042038 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:39.130840 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:39.130815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:42.368900 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:42.368867 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:30:42.472264 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:30:42.472236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:31:12.471531 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:12.471483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:31:12.573269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:12.573240 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:31:13.380587 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:13.380532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:31:13.629648 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:13.629613 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:31:21.593959 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:21.593845 2572 generic.go:356] "Generic (PLEG): container finished" podID="5c299396-1c5b-444a-bebf-d27a6f4b3ab2" containerID="8d60bc2e2b345c0f339226e175653bcada3db1fb330f27bddc5d8b9fba86e13e" exitCode=0 Jun 09 00:31:21.593959 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:21.593919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" event={"ID":"5c299396-1c5b-444a-bebf-d27a6f4b3ab2","Type":"ContainerDied","Data":"8d60bc2e2b345c0f339226e175653bcada3db1fb330f27bddc5d8b9fba86e13e"} Jun 09 00:31:21.594375 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:21.594282 2572 scope.go:117] "RemoveContainer" containerID="8d60bc2e2b345c0f339226e175653bcada3db1fb330f27bddc5d8b9fba86e13e" Jun 09 00:31:21.595264 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:21.595236 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:31:21.595321 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:21.595305 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:31:21.595356 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:21.595341 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:31:22.601293 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:22.601259 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" event={"ID":"5c299396-1c5b-444a-bebf-d27a6f4b3ab2","Type":"ContainerStarted","Data":"1b64f7e3cae983ea632ae47af7b7df836ff8f20726c5b03a5e89f3c46a0c8b65"} Jun 09 00:31:22.707360 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:22.707325 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:31:22.708454 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:22.708427 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfgsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 09 00:31:22.708587 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:22.708487 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" podUID="5c299396-1c5b-444a-bebf-d27a6f4b3ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 09 00:31:23.707874 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:23.707832 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfgsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 09 00:31:23.708331 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:23.707899 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" podUID="5c299396-1c5b-444a-bebf-d27a6f4b3ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 09 00:31:24.707594 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:24.707529 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfgsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 09 00:31:24.707774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:24.707632 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" podUID="5c299396-1c5b-444a-bebf-d27a6f4b3ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 09 00:31:25.707697 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:25.707659 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfgsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 09 00:31:25.708075 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:25.707722 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" podUID="5c299396-1c5b-444a-bebf-d27a6f4b3ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 09 00:31:25.772047 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:25.772010 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:31:26.711342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:26.711303 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:31:26.712351 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:26.712333 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfgsz" Jun 09 00:31:31.928912 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:31:31.928875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:11.792594 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.792562 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5595bb4f77-9jmzg"] Jun 09 00:32:11.793140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.792983 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bffcf440-e150-451f-83c9-685e1fdaf1e5" containerName="authorino" Jun 09 00:32:11.793140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.792998 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bffcf440-e150-451f-83c9-685e1fdaf1e5" containerName="authorino" Jun 09 00:32:11.793140 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.793099 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bffcf440-e150-451f-83c9-685e1fdaf1e5" containerName="authorino" Jun 09 00:32:11.795319 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.795304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.797969 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.797946 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 00:32:11.804003 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.803966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5595bb4f77-9jmzg"] Jun 09 00:32:11.887184 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.887143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b654716-4048-45b0-9d8e-849f8f8c07ab-tls-cert\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.887184 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.887185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzc7c\" (UniqueName: \"kubernetes.io/projected/2b654716-4048-45b0-9d8e-849f8f8c07ab-kube-api-access-rzc7c\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.887476 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.887207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b654716-4048-45b0-9d8e-849f8f8c07ab-oidc-ca\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.988748 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.988712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b654716-4048-45b0-9d8e-849f8f8c07ab-tls-cert\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.988748 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.988751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzc7c\" (UniqueName: \"kubernetes.io/projected/2b654716-4048-45b0-9d8e-849f8f8c07ab-kube-api-access-rzc7c\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.988971 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.988775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b654716-4048-45b0-9d8e-849f8f8c07ab-oidc-ca\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.989497 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.989473 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b654716-4048-45b0-9d8e-849f8f8c07ab-oidc-ca\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.991397 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.991375 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b654716-4048-45b0-9d8e-849f8f8c07ab-tls-cert\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:11.996227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:11.996198 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzc7c\" (UniqueName: \"kubernetes.io/projected/2b654716-4048-45b0-9d8e-849f8f8c07ab-kube-api-access-rzc7c\") pod \"authorino-5595bb4f77-9jmzg\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:12.105113 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.105014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:32:12.249980 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.249943 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5595bb4f77-9jmzg"] Jun 09 00:32:12.251797 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:32:12.251771 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b654716_4048_45b0_9d8e_849f8f8c07ab.slice/crio-7283418221cd0208977531cca306c1f735b6699afe2027ea02b37726e22199c5 WatchSource:0}: Error finding container 7283418221cd0208977531cca306c1f735b6699afe2027ea02b37726e22199c5: Status 404 returned error can't find the container with id 7283418221cd0208977531cca306c1f735b6699afe2027ea02b37726e22199c5 Jun 09 00:32:12.875943 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.875905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" event={"ID":"2b654716-4048-45b0-9d8e-849f8f8c07ab","Type":"ContainerStarted","Data":"3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99"} Jun 09 00:32:12.876356 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.875954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" event={"ID":"2b654716-4048-45b0-9d8e-849f8f8c07ab","Type":"ContainerStarted","Data":"7283418221cd0208977531cca306c1f735b6699afe2027ea02b37726e22199c5"} Jun 09 00:32:12.895240 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.895180 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" podStartSLOduration=1.487962507 podStartE2EDuration="1.895163559s" totalImagesPullingTime="407.201052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:32:12.893739819 +0000 UTC m=+744.941467257" watchObservedRunningTime="2026-06-09 00:32:12.895163559 +0000 UTC m=+744.942890995" Jun 09 00:32:12.925763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.925675 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b877d7997-mzhbg"] Jun 09 00:32:12.925920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:12.925858 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b877d7997-mzhbg" podUID="3c1658f9-64c2-49fc-8e27-a1a3625119bb" containerName="authorino" containerID="cri-o://c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63" gracePeriod=30 Jun 09 00:32:13.176214 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.176144 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:32:13.302171 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.302129 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c1658f9-64c2-49fc-8e27-a1a3625119bb-tls-cert\") pod \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " Jun 09 00:32:13.302336 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.302244 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knsw5\" (UniqueName: \"kubernetes.io/projected/3c1658f9-64c2-49fc-8e27-a1a3625119bb-kube-api-access-knsw5\") pod \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\" (UID: \"3c1658f9-64c2-49fc-8e27-a1a3625119bb\") " Jun 09 00:32:13.304258 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.304222 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1658f9-64c2-49fc-8e27-a1a3625119bb-kube-api-access-knsw5" (OuterVolumeSpecName: "kube-api-access-knsw5") pod "3c1658f9-64c2-49fc-8e27-a1a3625119bb" (UID: "3c1658f9-64c2-49fc-8e27-a1a3625119bb"). InnerVolumeSpecName "kube-api-access-knsw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:32:13.314939 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.314905 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c1658f9-64c2-49fc-8e27-a1a3625119bb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3c1658f9-64c2-49fc-8e27-a1a3625119bb" (UID: "3c1658f9-64c2-49fc-8e27-a1a3625119bb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:32:13.335821 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.335788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:13.403283 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.403244 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knsw5\" (UniqueName: \"kubernetes.io/projected/3c1658f9-64c2-49fc-8e27-a1a3625119bb-kube-api-access-knsw5\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:32:13.403283 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.403277 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c1658f9-64c2-49fc-8e27-a1a3625119bb-tls-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:32:13.435604 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.435479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:13.882422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.882334 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c1658f9-64c2-49fc-8e27-a1a3625119bb" containerID="c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63" exitCode=0 Jun 09 00:32:13.882422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.882378 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b877d7997-mzhbg" Jun 09 00:32:13.883008 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.882416 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b877d7997-mzhbg" event={"ID":"3c1658f9-64c2-49fc-8e27-a1a3625119bb","Type":"ContainerDied","Data":"c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63"} Jun 09 00:32:13.883008 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.882459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b877d7997-mzhbg" event={"ID":"3c1658f9-64c2-49fc-8e27-a1a3625119bb","Type":"ContainerDied","Data":"2b2a5ab15bd0cceeb0c538b12b69af8e2a9a857da4e46ba8e315ee3ebf11b9ab"} Jun 09 00:32:13.883008 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.882477 2572 scope.go:117] "RemoveContainer" containerID="c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63" Jun 09 00:32:13.892399 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.892382 2572 scope.go:117] "RemoveContainer" containerID="c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63" Jun 09 00:32:13.892720 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:32:13.892699 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63\": container with ID starting with c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63 not found: ID does not exist" containerID="c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63" Jun 09 00:32:13.892803 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.892732 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63"} err="failed to get container status \"c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63\": rpc error: code = NotFound desc = could not find container \"c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63\": container with ID starting with c1d310379383e46bf781f8f2771c05d84a810f8faa9cdc65668b8c0b4f302d63 not found: ID does not exist" Jun 09 00:32:13.903247 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.903221 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b877d7997-mzhbg"] Jun 09 00:32:13.906390 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:13.906368 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b877d7997-mzhbg"] Jun 09 00:32:14.384902 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:14.384867 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c1658f9-64c2-49fc-8e27-a1a3625119bb" path="/var/lib/kubelet/pods/3c1658f9-64c2-49fc-8e27-a1a3625119bb/volumes" Jun 09 00:32:25.437007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:25.436974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:27.112466 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:27.112437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:27.167610 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:27.167583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:29.144092 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:29.144056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:33.936136 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:33.936106 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:50.993402 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:50.993360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:51.043089 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:51.043047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:32:55.857697 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:32:55.857656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:33:11.458760 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:33:11.458684 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:33:16.045630 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:33:16.045581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:33:16.145851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:33:16.145816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:33:30.068249 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:33:30.068213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:33:34.712041 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:33:34.712000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:34:48.413328 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:34:48.413301 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:34:48.413328 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:34:48.413314 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:34:48.417627 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:34:48.417605 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:34:48.417995 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:34:48.417979 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:35:21.873566 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:21.873522 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7756866f56-x95rx"] Jun 09 00:35:21.873996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:21.873854 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1658f9-64c2-49fc-8e27-a1a3625119bb" containerName="authorino" Jun 09 00:35:21.873996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:21.873865 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1658f9-64c2-49fc-8e27-a1a3625119bb" containerName="authorino" Jun 09 00:35:21.873996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:21.873943 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1658f9-64c2-49fc-8e27-a1a3625119bb" containerName="authorino" Jun 09 00:35:21.876810 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:21.876790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:21.885620 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:21.885598 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7756866f56-x95rx"] Jun 09 00:35:22.008448 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.008418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7942f8b6-a60b-409a-a5d3-62a74592b1aa-tls-cert\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.008636 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.008511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7942f8b6-a60b-409a-a5d3-62a74592b1aa-oidc-ca\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.008636 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.008584 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47qpp\" (UniqueName: \"kubernetes.io/projected/7942f8b6-a60b-409a-a5d3-62a74592b1aa-kube-api-access-47qpp\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.109903 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.109882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7942f8b6-a60b-409a-a5d3-62a74592b1aa-oidc-ca\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.110007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.109918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47qpp\" (UniqueName: \"kubernetes.io/projected/7942f8b6-a60b-409a-a5d3-62a74592b1aa-kube-api-access-47qpp\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.110007 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.109948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7942f8b6-a60b-409a-a5d3-62a74592b1aa-tls-cert\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.110470 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.110453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7942f8b6-a60b-409a-a5d3-62a74592b1aa-oidc-ca\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.112176 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.112161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7942f8b6-a60b-409a-a5d3-62a74592b1aa-tls-cert\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.117988 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.117963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47qpp\" (UniqueName: \"kubernetes.io/projected/7942f8b6-a60b-409a-a5d3-62a74592b1aa-kube-api-access-47qpp\") pod \"authorino-7756866f56-x95rx\" (UID: \"7942f8b6-a60b-409a-a5d3-62a74592b1aa\") " pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.186941 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.186919 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7756866f56-x95rx" Jun 09 00:35:22.311918 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.311890 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7756866f56-x95rx"] Jun 09 00:35:22.313393 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:35:22.313365 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7942f8b6_a60b_409a_a5d3_62a74592b1aa.slice/crio-4c412e19be3cd014699128e3398c919179d9bb3bc4781f74860f33a2bbfc8a36 WatchSource:0}: Error finding container 4c412e19be3cd014699128e3398c919179d9bb3bc4781f74860f33a2bbfc8a36: Status 404 returned error can't find the container with id 4c412e19be3cd014699128e3398c919179d9bb3bc4781f74860f33a2bbfc8a36 Jun 09 00:35:22.434863 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.434835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:35:22.523526 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.523468 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:35:22.924850 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.924818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7756866f56-x95rx" event={"ID":"7942f8b6-a60b-409a-a5d3-62a74592b1aa","Type":"ContainerStarted","Data":"1fb4e64629dd930fe18e7116f1959f81095a461f5cbddd3fa344a61ba3fa703f"} Jun 09 00:35:22.925246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.924856 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7756866f56-x95rx" event={"ID":"7942f8b6-a60b-409a-a5d3-62a74592b1aa","Type":"ContainerStarted","Data":"4c412e19be3cd014699128e3398c919179d9bb3bc4781f74860f33a2bbfc8a36"} Jun 09 00:35:22.941260 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.941215 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7756866f56-x95rx" podStartSLOduration=1.5727247439999998 podStartE2EDuration="1.941199898s" totalImagesPullingTime="368.475154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:35:22.939496838 +0000 UTC m=+934.987224275" watchObservedRunningTime="2026-06-09 00:35:22.941199898 +0000 UTC m=+934.988927334" Jun 09 00:35:22.972677 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.972643 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5595bb4f77-9jmzg"] Jun 09 00:35:22.972858 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:22.972818 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" podUID="2b654716-4048-45b0-9d8e-849f8f8c07ab" containerName="authorino" containerID="cri-o://3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99" gracePeriod=30 Jun 09 00:35:23.217763 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.217741 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:35:23.324493 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.324466 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b654716-4048-45b0-9d8e-849f8f8c07ab-oidc-ca\") pod \"2b654716-4048-45b0-9d8e-849f8f8c07ab\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " Jun 09 00:35:23.324660 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.324503 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b654716-4048-45b0-9d8e-849f8f8c07ab-tls-cert\") pod \"2b654716-4048-45b0-9d8e-849f8f8c07ab\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " Jun 09 00:35:23.324660 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.324589 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzc7c\" (UniqueName: \"kubernetes.io/projected/2b654716-4048-45b0-9d8e-849f8f8c07ab-kube-api-access-rzc7c\") pod \"2b654716-4048-45b0-9d8e-849f8f8c07ab\" (UID: \"2b654716-4048-45b0-9d8e-849f8f8c07ab\") " Jun 09 00:35:23.326503 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.326458 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b654716-4048-45b0-9d8e-849f8f8c07ab-kube-api-access-rzc7c" (OuterVolumeSpecName: "kube-api-access-rzc7c") pod "2b654716-4048-45b0-9d8e-849f8f8c07ab" (UID: "2b654716-4048-45b0-9d8e-849f8f8c07ab"). InnerVolumeSpecName "kube-api-access-rzc7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:35:23.329191 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.329169 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b654716-4048-45b0-9d8e-849f8f8c07ab-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "2b654716-4048-45b0-9d8e-849f8f8c07ab" (UID: "2b654716-4048-45b0-9d8e-849f8f8c07ab"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:35:23.333910 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.333886 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b654716-4048-45b0-9d8e-849f8f8c07ab-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2b654716-4048-45b0-9d8e-849f8f8c07ab" (UID: "2b654716-4048-45b0-9d8e-849f8f8c07ab"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:35:23.425956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.425930 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzc7c\" (UniqueName: \"kubernetes.io/projected/2b654716-4048-45b0-9d8e-849f8f8c07ab-kube-api-access-rzc7c\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:35:23.425956 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.425955 2572 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2b654716-4048-45b0-9d8e-849f8f8c07ab-oidc-ca\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:35:23.426084 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.425969 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b654716-4048-45b0-9d8e-849f8f8c07ab-tls-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:35:23.500512 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.500450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:35:23.594422 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.594391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:35:23.932161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.932126 2572 generic.go:356] "Generic (PLEG): container finished" podID="2b654716-4048-45b0-9d8e-849f8f8c07ab" containerID="3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99" exitCode=0 Jun 09 00:35:23.932643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.932177 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" Jun 09 00:35:23.932643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.932172 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" event={"ID":"2b654716-4048-45b0-9d8e-849f8f8c07ab","Type":"ContainerDied","Data":"3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99"} Jun 09 00:35:23.932643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.932316 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595bb4f77-9jmzg" event={"ID":"2b654716-4048-45b0-9d8e-849f8f8c07ab","Type":"ContainerDied","Data":"7283418221cd0208977531cca306c1f735b6699afe2027ea02b37726e22199c5"} Jun 09 00:35:23.932643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.932345 2572 scope.go:117] "RemoveContainer" containerID="3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99" Jun 09 00:35:23.941871 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.941851 2572 scope.go:117] "RemoveContainer" containerID="3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99" Jun 09 00:35:23.942121 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:35:23.942101 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99\": container with ID starting with 3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99 not found: ID does not exist" containerID="3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99" Jun 09 00:35:23.942214 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.942129 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99"} err="failed to get container status \"3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99\": rpc error: code = NotFound desc = could not find container \"3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99\": container with ID starting with 3171f18f8257708faf50233833345991c05255b63265a9155f7c497984a96b99 not found: ID does not exist" Jun 09 00:35:23.952037 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.952017 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5595bb4f77-9jmzg"] Jun 09 00:35:23.958165 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:23.958139 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5595bb4f77-9jmzg"] Jun 09 00:35:24.383488 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:35:24.383397 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b654716-4048-45b0-9d8e-849f8f8c07ab" path="/var/lib/kubelet/pods/2b654716-4048-45b0-9d8e-849f8f8c07ab/volumes" Jun 09 00:36:49.042208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:36:49.042166 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:36:50.766221 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:36:50.766181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:37:30.540756 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:37:30.540669 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:37:30.631957 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:37:30.631920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:37:30.732895 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:37:30.732854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:37:39.033179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:37:39.033134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:37:44.590168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:37:44.590130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:37:44.644493 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:37:44.644465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:16.723576 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:16.723515 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:16.823911 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:16.823877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:16.934678 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:16.934641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:40.702490 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:40.702452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:46.493062 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:46.493018 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:46.616708 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:46.616664 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:46.707001 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:46.706967 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:46.840798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:46.840696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:46.942520 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:46.942479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:38:55.306759 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:38:55.306722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:03.350107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:03.350014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:03.460567 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:03.460525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:03.571362 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:03.571324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:09.422930 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:09.422895 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:09.481925 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:09.481898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:17.570168 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:17.570075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:17.669209 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:17.669173 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:17.770341 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:17.770306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:17.877888 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:17.877802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:34.323816 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:34.323777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:34.427521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:34.427491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:34.542503 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:34.542467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:40.371993 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:40.371963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:40.431484 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:40.431448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:39:48.456080 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:48.456049 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:39:48.458771 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:48.458740 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:39:48.461047 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:48.461029 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:39:48.463769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:39:48.463752 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:40:00.778368 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:00.778329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:00.878220 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:00.878184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:01.019617 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:01.019584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:06.584984 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:06.584947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:06.703296 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:06.703263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:06.785776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:06.785737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:06.936518 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:06.936485 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:12.555369 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:12.555329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:12.613436 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:12.613401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:34.022047 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:34.021964 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:40:34.071107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:40:34.071069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:42:02.267598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:42:02.267490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:42:10.855199 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:42:10.855164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:44:38.610932 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:44:38.610902 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:44:38.661324 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:44:38.661289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:44:48.491840 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:44:48.491816 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:44:48.495953 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:44:48.495931 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:44:48.496153 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:44:48.496140 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:44:48.500058 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:44:48.500039 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:45:00.138748 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.138660 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb"] Jun 09 00:45:00.139125 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.139104 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b654716-4048-45b0-9d8e-849f8f8c07ab" containerName="authorino" Jun 09 00:45:00.139125 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.139120 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b654716-4048-45b0-9d8e-849f8f8c07ab" containerName="authorino" Jun 09 00:45:00.139204 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.139188 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b654716-4048-45b0-9d8e-849f8f8c07ab" containerName="authorino" Jun 09 00:45:00.142352 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.142333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:45:00.144592 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.144529 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-75g5x\"" Jun 09 00:45:00.156309 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.156286 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb"] Jun 09 00:45:00.314682 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.314642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jgfz\" (UniqueName: \"kubernetes.io/projected/ed943559-e63e-49a8-978c-00183a24ba87-kube-api-access-4jgfz\") pod \"maas-api-key-cleanup-29682765-gw9xb\" (UID: \"ed943559-e63e-49a8-978c-00183a24ba87\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:45:00.415278 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.415209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jgfz\" (UniqueName: \"kubernetes.io/projected/ed943559-e63e-49a8-978c-00183a24ba87-kube-api-access-4jgfz\") pod \"maas-api-key-cleanup-29682765-gw9xb\" (UID: \"ed943559-e63e-49a8-978c-00183a24ba87\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:45:00.422894 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.422868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jgfz\" (UniqueName: \"kubernetes.io/projected/ed943559-e63e-49a8-978c-00183a24ba87-kube-api-access-4jgfz\") pod \"maas-api-key-cleanup-29682765-gw9xb\" (UID: \"ed943559-e63e-49a8-978c-00183a24ba87\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:45:00.452264 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.452243 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:45:00.581439 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.581413 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb"] Jun 09 00:45:00.583799 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:45:00.583775 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded943559_e63e_49a8_978c_00183a24ba87.slice/crio-5c8613346b5868ece15fd2055466eb214499ede30d81391cb1ee3319552487f1 WatchSource:0}: Error finding container 5c8613346b5868ece15fd2055466eb214499ede30d81391cb1ee3319552487f1: Status 404 returned error can't find the container with id 5c8613346b5868ece15fd2055466eb214499ede30d81391cb1ee3319552487f1 Jun 09 00:45:00.585703 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.585682 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:45:00.985297 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:00.985266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" event={"ID":"ed943559-e63e-49a8-978c-00183a24ba87","Type":"ContainerStarted","Data":"5c8613346b5868ece15fd2055466eb214499ede30d81391cb1ee3319552487f1"} Jun 09 00:45:04.002729 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:04.002692 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" event={"ID":"ed943559-e63e-49a8-978c-00183a24ba87","Type":"ContainerStarted","Data":"9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809"} Jun 09 00:45:04.016029 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:45:04.015967 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" podStartSLOduration=1.646151901 podStartE2EDuration="4.015950021s" totalImagesPullingTime="2.36979812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:45:04.015629178 +0000 UTC m=+1516.063356613" watchObservedRunningTime="2026-06-09 00:45:04.015950021 +0000 UTC m=+1516.063677450" Jun 09 00:46:00.012364 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:00.012314 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb"] Jun 09 00:46:00.013022 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:00.012619 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" podUID="ed943559-e63e-49a8-978c-00183a24ba87" containerName="cleanup" containerID="cri-o://9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809" gracePeriod=30 Jun 09 00:46:30.189591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.189550 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:46:30.226675 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.226654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jgfz\" (UniqueName: \"kubernetes.io/projected/ed943559-e63e-49a8-978c-00183a24ba87-kube-api-access-4jgfz\") pod \"ed943559-e63e-49a8-978c-00183a24ba87\" (UID: \"ed943559-e63e-49a8-978c-00183a24ba87\") " Jun 09 00:46:30.228675 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.228649 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed943559-e63e-49a8-978c-00183a24ba87-kube-api-access-4jgfz" (OuterVolumeSpecName: "kube-api-access-4jgfz") pod "ed943559-e63e-49a8-978c-00183a24ba87" (UID: "ed943559-e63e-49a8-978c-00183a24ba87"). InnerVolumeSpecName "kube-api-access-4jgfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:46:30.328332 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.328280 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jgfz\" (UniqueName: \"kubernetes.io/projected/ed943559-e63e-49a8-978c-00183a24ba87-kube-api-access-4jgfz\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:46:30.469483 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.469459 2572 generic.go:356] "Generic (PLEG): container finished" podID="ed943559-e63e-49a8-978c-00183a24ba87" containerID="9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809" exitCode=137 Jun 09 00:46:30.469605 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.469498 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" Jun 09 00:46:30.469605 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.469547 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" event={"ID":"ed943559-e63e-49a8-978c-00183a24ba87","Type":"ContainerDied","Data":"9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809"} Jun 09 00:46:30.469684 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.469616 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb" event={"ID":"ed943559-e63e-49a8-978c-00183a24ba87","Type":"ContainerDied","Data":"5c8613346b5868ece15fd2055466eb214499ede30d81391cb1ee3319552487f1"} Jun 09 00:46:30.469684 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.469637 2572 scope.go:117] "RemoveContainer" containerID="9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809" Jun 09 00:46:30.477898 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.477884 2572 scope.go:117] "RemoveContainer" containerID="9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809" Jun 09 00:46:30.478149 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:46:30.478130 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809\": container with ID starting with 9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809 not found: ID does not exist" containerID="9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809" Jun 09 00:46:30.478240 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.478153 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809"} err="failed to get container status \"9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809\": rpc error: code = NotFound desc = could not find container \"9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809\": container with ID starting with 9c50317c8d7355e6c058a244a441a745a8c56aceddebeb7386aada26aa393809 not found: ID does not exist" Jun 09 00:46:30.486602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.486583 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb"] Jun 09 00:46:30.488450 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:30.488432 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29682765-gw9xb"] Jun 09 00:46:32.383632 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:46:32.383602 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed943559-e63e-49a8-978c-00183a24ba87" path="/var/lib/kubelet/pods/ed943559-e63e-49a8-978c-00183a24ba87/volumes" Jun 09 00:47:13.446339 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:13.446291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:47:14.468701 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:14.468659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:47:16.793997 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:16.793961 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl"] Jun 09 00:47:16.794426 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:16.794161 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" podUID="d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" containerName="manager" containerID="cri-o://419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c" gracePeriod=10 Jun 09 00:47:17.043815 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.043791 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:47:17.192109 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.192085 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-extensions-socket-volume\") pod \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " Jun 09 00:47:17.192243 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.192150 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlddq\" (UniqueName: \"kubernetes.io/projected/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-kube-api-access-tlddq\") pod \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\" (UID: \"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec\") " Jun 09 00:47:17.192418 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.192397 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" (UID: "d403d024-1ae5-4aa6-9bba-8c9a9ec7caec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:47:17.193999 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.193981 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-kube-api-access-tlddq" (OuterVolumeSpecName: "kube-api-access-tlddq") pod "d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" (UID: "d403d024-1ae5-4aa6-9bba-8c9a9ec7caec"). InnerVolumeSpecName "kube-api-access-tlddq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:47:17.293257 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.293232 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-extensions-socket-volume\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:47:17.293257 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.293254 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlddq\" (UniqueName: \"kubernetes.io/projected/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec-kube-api-access-tlddq\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:47:17.723521 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.723487 2572 generic.go:356] "Generic (PLEG): container finished" podID="d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" containerID="419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c" exitCode=0 Jun 09 00:47:17.723687 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.723548 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" Jun 09 00:47:17.723687 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.723583 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" event={"ID":"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec","Type":"ContainerDied","Data":"419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c"} Jun 09 00:47:17.723687 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.723655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl" event={"ID":"d403d024-1ae5-4aa6-9bba-8c9a9ec7caec","Type":"ContainerDied","Data":"721557b67cb8ccaba1cffbec5942e16c170f2b168ad7db0ec46b42167b84682e"} Jun 09 00:47:17.723850 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.723688 2572 scope.go:117] "RemoveContainer" containerID="419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c" Jun 09 00:47:17.734548 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.734524 2572 scope.go:117] "RemoveContainer" containerID="419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c" Jun 09 00:47:17.734857 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:47:17.734835 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c\": container with ID starting with 419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c not found: ID does not exist" containerID="419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c" Jun 09 00:47:17.734902 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.734866 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c"} err="failed to get container status \"419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c\": rpc error: code = NotFound desc = could not find container \"419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c\": container with ID starting with 419c9fa5600c0d5e6db4893ec5a3778de42f46b001db13dae251fab6b738cb8c not found: ID does not exist" Jun 09 00:47:17.746327 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.746299 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl"] Jun 09 00:47:17.750501 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:17.750475 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ntzl"] Jun 09 00:47:18.383932 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:47:18.383904 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" path="/var/lib/kubelet/pods/d403d024-1ae5-4aa6-9bba-8c9a9ec7caec/volumes" Jun 09 00:48:22.908295 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908214 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v"] Jun 09 00:48:22.908776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908620 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed943559-e63e-49a8-978c-00183a24ba87" containerName="cleanup" Jun 09 00:48:22.908776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908633 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed943559-e63e-49a8-978c-00183a24ba87" containerName="cleanup" Jun 09 00:48:22.908776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908641 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" containerName="manager" Jun 09 00:48:22.908776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908647 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" containerName="manager" Jun 09 00:48:22.908776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908711 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed943559-e63e-49a8-978c-00183a24ba87" containerName="cleanup" Jun 09 00:48:22.908776 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.908720 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d403d024-1ae5-4aa6-9bba-8c9a9ec7caec" containerName="manager" Jun 09 00:48:22.911341 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.911323 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:22.913835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.913809 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-frs22\"" Jun 09 00:48:22.924242 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:22.924215 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v"] Jun 09 00:48:23.001524 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.001496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8c11e21-4f9c-4857-a484-6fa4afef48c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vlt4v\" (UID: \"c8c11e21-4f9c-4857-a484-6fa4afef48c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.001674 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.001622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt78q\" (UniqueName: \"kubernetes.io/projected/c8c11e21-4f9c-4857-a484-6fa4afef48c0-kube-api-access-lt78q\") pod \"kuadrant-operator-controller-manager-86878c769f-vlt4v\" (UID: \"c8c11e21-4f9c-4857-a484-6fa4afef48c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.102958 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.102934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt78q\" (UniqueName: \"kubernetes.io/projected/c8c11e21-4f9c-4857-a484-6fa4afef48c0-kube-api-access-lt78q\") pod \"kuadrant-operator-controller-manager-86878c769f-vlt4v\" (UID: \"c8c11e21-4f9c-4857-a484-6fa4afef48c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.103056 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.102972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8c11e21-4f9c-4857-a484-6fa4afef48c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vlt4v\" (UID: \"c8c11e21-4f9c-4857-a484-6fa4afef48c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.103269 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.103256 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8c11e21-4f9c-4857-a484-6fa4afef48c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vlt4v\" (UID: \"c8c11e21-4f9c-4857-a484-6fa4afef48c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.111313 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.111289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt78q\" (UniqueName: \"kubernetes.io/projected/c8c11e21-4f9c-4857-a484-6fa4afef48c0-kube-api-access-lt78q\") pod \"kuadrant-operator-controller-manager-86878c769f-vlt4v\" (UID: \"c8c11e21-4f9c-4857-a484-6fa4afef48c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.221894 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.221838 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:23.361617 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:23.361591 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v"] Jun 09 00:48:23.363289 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:48:23.363254 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c11e21_4f9c_4857_a484_6fa4afef48c0.slice/crio-d0700ffb7248ecf5aa7fec9fb8dc88564095a6d8f7df6ab5815bfb75d533641b WatchSource:0}: Error finding container d0700ffb7248ecf5aa7fec9fb8dc88564095a6d8f7df6ab5815bfb75d533641b: Status 404 returned error can't find the container with id d0700ffb7248ecf5aa7fec9fb8dc88564095a6d8f7df6ab5815bfb75d533641b Jun 09 00:48:24.094008 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:24.093972 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" event={"ID":"c8c11e21-4f9c-4857-a484-6fa4afef48c0","Type":"ContainerStarted","Data":"448b0bc919194d654afb659ff40dff62b4e80cfc24483de40ccc907cc977e2b6"} Jun 09 00:48:24.094347 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:24.094051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" event={"ID":"c8c11e21-4f9c-4857-a484-6fa4afef48c0","Type":"ContainerStarted","Data":"d0700ffb7248ecf5aa7fec9fb8dc88564095a6d8f7df6ab5815bfb75d533641b"} Jun 09 00:48:24.094347 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:24.094078 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:48:24.115977 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:24.115936 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" podStartSLOduration=2.115921989 podStartE2EDuration="2.115921989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:48:24.11288808 +0000 UTC m=+1716.160615526" watchObservedRunningTime="2026-06-09 00:48:24.115921989 +0000 UTC m=+1716.163649424" Jun 09 00:48:35.101856 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:48:35.101819 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vlt4v" Jun 09 00:49:48.532782 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:49:48.532756 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:49:48.537102 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:49:48.537081 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:49:48.537930 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:49:48.537900 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:49:48.542812 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:49:48.542794 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:50:25.745704 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:50:25.745661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:54:48.569041 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:54:48.569014 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:54:48.573658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:54:48.573638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:54:48.576975 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:54:48.576952 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:54:48.581227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:54:48.581205 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:56:36.915430 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:56:36.915398 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:56:38.091179 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:56:38.091141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:04.039416 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:04.039298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:09.422057 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:09.422024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:33.682963 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:33.682923 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:46.766489 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:46.766449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:48.369941 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.369910 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9"] Jun 09 00:57:48.373662 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.373641 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.375945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.375921 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9920d9f4-openshift-default-dockercfg-2gmpk\"" Jun 09 00:57:48.395784 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.395755 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9"] Jun 09 00:57:48.401196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.401163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:48.457840 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.457812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:48.485991 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.485960 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-envoy\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486117 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-socket\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486117 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-certs\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486214 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-credential-socket\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486214 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a544db67-24f6-4454-8406-32ea61f47437-istio-podinfo\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486291 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-data\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486291 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-istio-token\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486413 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v586w\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-kube-api-access-v586w\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.486473 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.486433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a544db67-24f6-4454-8406-32ea61f47437-istiod-ca-cert\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.560190 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.560160 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:48.587297 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-envoy\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-socket\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587331 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-certs\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-credential-socket\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a544db67-24f6-4454-8406-32ea61f47437-istio-podinfo\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-data\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-istio-token\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587752 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v586w\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-kube-api-access-v586w\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587752 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a544db67-24f6-4454-8406-32ea61f47437-istiod-ca-cert\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587865 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587776 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-certs\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587865 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587798 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-credential-socket\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.587966 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.587868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-data\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.588047 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.588018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-socket\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.588304 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.588283 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a544db67-24f6-4454-8406-32ea61f47437-istiod-ca-cert\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.589642 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.589620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-envoy\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.589797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.589777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a544db67-24f6-4454-8406-32ea61f47437-istio-podinfo\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.598477 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.598457 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v586w\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-kube-api-access-v586w\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.598840 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.598821 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-istio-token\") pod \"e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.637777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.637750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:48.686346 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.686320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:48.696461 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.696414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:48.835285 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.835253 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9"] Jun 09 00:57:48.835571 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:57:48.835532 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda544db67_24f6_4454_8406_32ea61f47437.slice/crio-27a4964ab930bc59bc46628b01a30d21bfc5db3f3d79ec95589f25fa9fa54ace WatchSource:0}: Error finding container 27a4964ab930bc59bc46628b01a30d21bfc5db3f3d79ec95589f25fa9fa54ace: Status 404 returned error can't find the container with id 27a4964ab930bc59bc46628b01a30d21bfc5db3f3d79ec95589f25fa9fa54ace Jun 09 00:57:48.837708 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.837674 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:57:48.837790 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.837748 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:57:48.837827 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.837789 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:57:48.933450 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:48.933414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:49.033869 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.033788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:49.059320 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.059280 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" event={"ID":"a544db67-24f6-4454-8406-32ea61f47437","Type":"ContainerStarted","Data":"4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646"} Jun 09 00:57:49.059492 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.059357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" event={"ID":"a544db67-24f6-4454-8406-32ea61f47437","Type":"ContainerStarted","Data":"27a4964ab930bc59bc46628b01a30d21bfc5db3f3d79ec95589f25fa9fa54ace"} Jun 09 00:57:49.083009 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.082966 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" podStartSLOduration=1.082952709 podStartE2EDuration="1.082952709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:57:49.080275205 +0000 UTC m=+2281.128002641" watchObservedRunningTime="2026-06-09 00:57:49.082952709 +0000 UTC m=+2281.130680146" Jun 09 00:57:49.670363 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.670332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:49.687369 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.687341 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:49.692442 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.692419 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:49.787211 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:49.787182 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:50.064580 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:50.064484 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:50.065359 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:50.065343 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:50.427085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:50.427052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:50.564972 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:50.564938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:51.105567 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:51.105513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:51.701768 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:51.701734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:51.802270 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:51.802236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:52.304435 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:52.304401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:52.905366 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:52.905329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:54.730150 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:54.730113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:54.826572 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:54.826524 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9"] Jun 09 00:57:54.826820 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:54.826794 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" podUID="a544db67-24f6-4454-8406-32ea61f47437" containerName="istio-proxy" containerID="cri-o://4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646" gracePeriod=30 Jun 09 00:57:54.849208 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:54.849161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:54.955367 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:54.955332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:56.360716 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:56.360646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:57:59.376894 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.376844 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:57:59.487603 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487534 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-envoy\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487610 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a544db67-24f6-4454-8406-32ea61f47437-istiod-ca-cert\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487632 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-socket\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-credential-socket\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487710 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487677 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-data\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487720 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a544db67-24f6-4454-8406-32ea61f47437-istio-podinfo\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487760 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v586w\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-kube-api-access-v586w\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487786 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-certs\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.487920 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487807 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-istio-token\") pod \"a544db67-24f6-4454-8406-32ea61f47437\" (UID: \"a544db67-24f6-4454-8406-32ea61f47437\") " Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487921 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.487947 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.488017 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a544db67-24f6-4454-8406-32ea61f47437-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.488103 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a544db67-24f6-4454-8406-32ea61f47437-istiod-ca-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.488105 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.488119 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-socket\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.488130 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.488132 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-credential-socket\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.488769 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.488743 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-data" (OuterVolumeSpecName: "istio-data") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:57:59.489962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.489935 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-kube-api-access-v586w" (OuterVolumeSpecName: "kube-api-access-v586w") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "kube-api-access-v586w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:57:59.490059 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.490026 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a544db67-24f6-4454-8406-32ea61f47437-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 00:57:59.490122 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.490100 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:57:59.490161 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.490123 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-istio-token" (OuterVolumeSpecName: "istio-token") pod "a544db67-24f6-4454-8406-32ea61f47437" (UID: "a544db67-24f6-4454-8406-32ea61f47437"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:57:59.588828 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.588808 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-data\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.588828 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.588827 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a544db67-24f6-4454-8406-32ea61f47437-istio-podinfo\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.588950 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.588836 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v586w\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-kube-api-access-v586w\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.588950 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.588845 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-workload-certs\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.588950 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.588852 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a544db67-24f6-4454-8406-32ea61f47437-istio-token\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:57:59.588950 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:57:59.588859 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a544db67-24f6-4454-8406-32ea61f47437-istio-envoy\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:00.116619 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.116590 2572 generic.go:356] "Generic (PLEG): container finished" podID="a544db67-24f6-4454-8406-32ea61f47437" containerID="4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646" exitCode=0 Jun 09 00:58:00.116777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.116639 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" Jun 09 00:58:00.116777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.116679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" event={"ID":"a544db67-24f6-4454-8406-32ea61f47437","Type":"ContainerDied","Data":"4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646"} Jun 09 00:58:00.116777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.116741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9" event={"ID":"a544db67-24f6-4454-8406-32ea61f47437","Type":"ContainerDied","Data":"27a4964ab930bc59bc46628b01a30d21bfc5db3f3d79ec95589f25fa9fa54ace"} Jun 09 00:58:00.116777 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.116769 2572 scope.go:117] "RemoveContainer" containerID="4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646" Jun 09 00:58:00.125793 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.125778 2572 scope.go:117] "RemoveContainer" containerID="4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646" Jun 09 00:58:00.126029 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:58:00.126008 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646\": container with ID starting with 4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646 not found: ID does not exist" containerID="4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646" Jun 09 00:58:00.126132 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.126030 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646"} err="failed to get container status \"4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646\": rpc error: code = NotFound desc = could not find container \"4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646\": container with ID starting with 4642b4dfdb9fd1820950118d146be7da3c6cf43e871b9a3b2ff6608351bd2646 not found: ID does not exist" Jun 09 00:58:00.137169 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.137147 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9"] Jun 09 00:58:00.143186 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.143164 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9920d9f4-openshift-default-ddcc5f6b8-kxkf9"] Jun 09 00:58:00.383469 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.383393 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a544db67-24f6-4454-8406-32ea61f47437" path="/var/lib/kubelet/pods/a544db67-24f6-4454-8406-32ea61f47437/volumes" Jun 09 00:58:00.733704 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.733678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:00.837374 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.837342 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:00.907141 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.907106 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz"] Jun 09 00:58:00.907588 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.907565 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a544db67-24f6-4454-8406-32ea61f47437" containerName="istio-proxy" Jun 09 00:58:00.907588 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.907588 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a544db67-24f6-4454-8406-32ea61f47437" containerName="istio-proxy" Jun 09 00:58:00.907761 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.907676 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a544db67-24f6-4454-8406-32ea61f47437" containerName="istio-proxy" Jun 09 00:58:00.912415 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.912397 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:00.914664 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.914640 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c658b559-openshift-default-dockercfg-t8wz7\"" Jun 09 00:58:00.925066 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.925041 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz"] Jun 09 00:58:00.952310 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:00.952283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.001403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daecf420-c305-4914-9738-0e691df757e1-istiod-ca-cert\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daecf420-c305-4914-9738-0e691df757e1-istio-podinfo\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001526 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-credential-socket\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001526 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-data\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001623 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-istio-token\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001623 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2k7\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-kube-api-access-wx2k7\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001695 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-socket\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001695 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-envoy\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.001695 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.001686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-certs\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.009795 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.009773 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.103071 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-socket\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-envoy\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103094 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-certs\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daecf420-c305-4914-9738-0e691df757e1-istiod-ca-cert\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daecf420-c305-4914-9738-0e691df757e1-istio-podinfo\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103175 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-credential-socket\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-data\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103224 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103251 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-istio-token\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2k7\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-kube-api-access-wx2k7\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103510 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-socket\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103583 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-certs\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103740 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103692 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-credential-socket\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103943 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-data\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.103996 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.103946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daecf420-c305-4914-9738-0e691df757e1-istiod-ca-cert\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.105766 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.105744 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-envoy\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.106231 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.106203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daecf420-c305-4914-9738-0e691df757e1-istio-podinfo\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.113266 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.113243 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2k7\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-kube-api-access-wx2k7\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.113507 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.113475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-istio-token\") pod \"e2e-ait-c658b559-openshift-default-7795b97688-p4fcz\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.116473 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.116444 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.214829 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.214794 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.223796 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.223763 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:01.313403 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.313226 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.367764 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.367737 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz"] Jun 09 00:58:01.369523 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:58:01.369492 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaecf420_c305_4914_9738_0e691df757e1.slice/crio-76db0749720bb6f1651d3d2c36c5f1fd836e73fec375f22340a16851c74af992 WatchSource:0}: Error finding container 76db0749720bb6f1651d3d2c36c5f1fd836e73fec375f22340a16851c74af992: Status 404 returned error can't find the container with id 76db0749720bb6f1651d3d2c36c5f1fd836e73fec375f22340a16851c74af992 Jun 09 00:58:01.371411 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.371273 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.371934 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.371897 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:58:01.372042 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.371975 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:58:01.372042 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.372024 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 00:58:01.492970 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.492934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.593534 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.593429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:01.698704 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:01.698669 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:02.129690 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.129658 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" event={"ID":"daecf420-c305-4914-9738-0e691df757e1","Type":"ContainerStarted","Data":"ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b"} Jun 09 00:58:02.129859 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.129716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" event={"ID":"daecf420-c305-4914-9738-0e691df757e1","Type":"ContainerStarted","Data":"76db0749720bb6f1651d3d2c36c5f1fd836e73fec375f22340a16851c74af992"} Jun 09 00:58:02.150167 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.150124 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" podStartSLOduration=2.150108279 podStartE2EDuration="2.150108279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:58:02.147123257 +0000 UTC m=+2294.194850693" watchObservedRunningTime="2026-06-09 00:58:02.150108279 +0000 UTC m=+2294.197835716" Jun 09 00:58:02.224294 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.224260 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:02.228663 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.228635 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:02.295334 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.295298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:02.893385 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:02.893352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:03.134697 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:03.134667 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:03.135598 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:03.135575 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:03.493994 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:03.493916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:04.098374 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:04.098340 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:04.486302 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:04.486265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:04.693879 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:04.693826 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:05.294732 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:05.294685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:07.223633 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:07.223598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:08.355851 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:08.355818 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz"] Jun 09 00:58:08.356588 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:08.356536 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" podUID="daecf420-c305-4914-9738-0e691df757e1" containerName="istio-proxy" containerID="cri-o://ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b" gracePeriod=30 Jun 09 00:58:08.381633 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:08.381610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:08.481323 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:08.481286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:11.398246 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.398222 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:11.501907 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.501853 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-credential-socket\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.501907 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.501896 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-envoy\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.501920 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-socket\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.501946 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-istio-token\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502019 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daecf420-c305-4914-9738-0e691df757e1-istiod-ca-cert\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502043 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:58:11.502085 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502064 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-certs\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502240 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx2k7\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-kube-api-access-wx2k7\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502240 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:58:11.502342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502286 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-data\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502337 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daecf420-c305-4914-9738-0e691df757e1-istio-podinfo\") pod \"daecf420-c305-4914-9738-0e691df757e1\" (UID: \"daecf420-c305-4914-9738-0e691df757e1\") " Jun 09 00:58:11.502787 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502286 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:58:11.502787 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502591 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daecf420-c305-4914-9738-0e691df757e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 00:58:11.502787 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502694 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-credential-socket\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.502787 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.502748 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-socket\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.503229 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.503201 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:58:11.504220 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.504199 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 00:58:11.504503 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.504474 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-kube-api-access-wx2k7" (OuterVolumeSpecName: "kube-api-access-wx2k7") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "kube-api-access-wx2k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:58:11.504610 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.504496 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:58:11.504657 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.504605 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/daecf420-c305-4914-9738-0e691df757e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "daecf420-c305-4914-9738-0e691df757e1" (UID: "daecf420-c305-4914-9738-0e691df757e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 00:58:11.553516 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.553487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:11.603517 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603495 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-istio-token\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.603517 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603517 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daecf420-c305-4914-9738-0e691df757e1-istiod-ca-cert\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.603661 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603526 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-workload-certs\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.603661 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603534 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx2k7\" (UniqueName: \"kubernetes.io/projected/daecf420-c305-4914-9738-0e691df757e1-kube-api-access-wx2k7\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.603661 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603543 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-data\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.603661 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603574 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daecf420-c305-4914-9738-0e691df757e1-istio-podinfo\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:11.603661 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:11.603586 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daecf420-c305-4914-9738-0e691df757e1-istio-envoy\") on node \"ip-10-0-140-224.ec2.internal\" DevicePath \"\"" Jun 09 00:58:12.193652 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.193604 2572 generic.go:356] "Generic (PLEG): container finished" podID="daecf420-c305-4914-9738-0e691df757e1" containerID="ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b" exitCode=0 Jun 09 00:58:12.193835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.193659 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" Jun 09 00:58:12.193835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.193694 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" event={"ID":"daecf420-c305-4914-9738-0e691df757e1","Type":"ContainerDied","Data":"ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b"} Jun 09 00:58:12.193835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.193765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz" event={"ID":"daecf420-c305-4914-9738-0e691df757e1","Type":"ContainerDied","Data":"76db0749720bb6f1651d3d2c36c5f1fd836e73fec375f22340a16851c74af992"} Jun 09 00:58:12.193835 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.193792 2572 scope.go:117] "RemoveContainer" containerID="ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b" Jun 09 00:58:12.204286 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.204269 2572 scope.go:117] "RemoveContainer" containerID="ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b" Jun 09 00:58:12.204576 ip-10-0-140-224 kubenswrapper[2572]: E0609 00:58:12.204538 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b\": container with ID starting with ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b not found: ID does not exist" containerID="ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b" Jun 09 00:58:12.204643 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.204588 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b"} err="failed to get container status \"ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b\": rpc error: code = NotFound desc = could not find container \"ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b\": container with ID starting with ab8a1873408364b9429e909040ae5d10c47a84542d1a68def5bc0ec8432d107b not found: ID does not exist" Jun 09 00:58:12.217343 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.217314 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz"] Jun 09 00:58:12.220884 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.220852 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c658b559-openshift-default-7795b97688-p4fcz"] Jun 09 00:58:12.384040 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:12.384010 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daecf420-c305-4914-9738-0e691df757e1" path="/var/lib/kubelet/pods/daecf420-c305-4914-9738-0e691df757e1/volumes" Jun 09 00:58:14.315683 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:14.315643 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:14.374476 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:14.374442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:20.526492 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:20.526450 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7756866f56-x95rx_7942f8b6-a60b-409a-a5d3-62a74592b1aa/authorino/0.log" Jun 09 00:58:24.973742 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:24.973708 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64c7bc99c9-kqdtd_4ad0d4c2-82c1-4e1a-a896-5cc84dca719e/nginx/0.log" Jun 09 00:58:25.954073 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:25.954043 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-8l48b_933b11b1-b3e2-4ce2-84ca-335488d23a44/copy-manifests/0.log" Jun 09 00:58:25.976451 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:25.976402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-8l48b_933b11b1-b3e2-4ce2-84ca-335488d23a44/manager/0.log" Jun 09 00:58:26.878684 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:26.878633 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q_e68646e1-e4c0-4274-b5e6-469d0a5923b3/util/0.log" Jun 09 00:58:26.884086 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:26.884060 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q_e68646e1-e4c0-4274-b5e6-469d0a5923b3/pull/0.log" Jun 09 00:58:26.890918 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:26.890887 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q_e68646e1-e4c0-4274-b5e6-469d0a5923b3/extract/0.log" Jun 09 00:58:26.999791 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:26.999768 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm_5de55dc7-5ea7-4f38-a1bd-ab804fa1168f/extract/0.log" Jun 09 00:58:27.005364 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.005343 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm_5de55dc7-5ea7-4f38-a1bd-ab804fa1168f/util/0.log" Jun 09 00:58:27.011317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.011290 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm_5de55dc7-5ea7-4f38-a1bd-ab804fa1168f/pull/0.log" Jun 09 00:58:27.122717 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.122698 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp_d904901b-8997-4f6d-8a3d-8e6c34bc7ce4/extract/0.log" Jun 09 00:58:27.128373 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.128350 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp_d904901b-8997-4f6d-8a3d-8e6c34bc7ce4/util/0.log" Jun 09 00:58:27.134715 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.134654 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp_d904901b-8997-4f6d-8a3d-8e6c34bc7ce4/pull/0.log" Jun 09 00:58:27.241962 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.241941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759_7fea35a8-be0c-4b65-ac83-f2e1b1791446/util/0.log" Jun 09 00:58:27.248730 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.248709 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759_7fea35a8-be0c-4b65-ac83-f2e1b1791446/pull/0.log" Jun 09 00:58:27.255212 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.255192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759_7fea35a8-be0c-4b65-ac83-f2e1b1791446/extract/0.log" Jun 09 00:58:27.394912 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.394885 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7756866f56-x95rx_7942f8b6-a60b-409a-a5d3-62a74592b1aa/authorino/0.log" Jun 09 00:58:27.637524 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.637489 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7sgtv_9f02aa10-68d4-4cdf-863e-5c56bd7cedf6/manager/0.log" Jun 09 00:58:27.862738 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.862617 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cf5dq_3b7be235-53ba-4fd3-8102-0ddf22d40bcf/registry-server/0.log" Jun 09 00:58:27.990945 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:27.990918 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vlt4v_c8c11e21-4f9c-4857-a484-6fa4afef48c0/manager/0.log" Jun 09 00:58:28.558259 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:28.558238 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pcwfd_a4ad282a-0cf9-41e1-b685-81f7c1302fea/istio-proxy/0.log" Jun 09 00:58:29.019570 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:29.019531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/1.log" Jun 09 00:58:34.040714 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.040681 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mc7xn/must-gather-6ktx6"] Jun 09 00:58:34.041114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.041081 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daecf420-c305-4914-9738-0e691df757e1" containerName="istio-proxy" Jun 09 00:58:34.041114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.041108 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="daecf420-c305-4914-9738-0e691df757e1" containerName="istio-proxy" Jun 09 00:58:34.041249 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.041225 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="daecf420-c305-4914-9738-0e691df757e1" containerName="istio-proxy" Jun 09 00:58:34.046136 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.046115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.049170 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.049148 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mc7xn\"/\"kube-root-ca.crt\"" Jun 09 00:58:34.049289 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.049170 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mc7xn\"/\"openshift-service-ca.crt\"" Jun 09 00:58:34.049289 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.049170 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mc7xn\"/\"default-dockercfg-x5l9b\"" Jun 09 00:58:34.051675 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.051645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc7xn/must-gather-6ktx6"] Jun 09 00:58:34.053299 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.053270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:34.072454 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.072428 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96c27743-7503-41b8-abf0-87f55ec965e7-must-gather-output\") pod \"must-gather-6ktx6\" (UID: \"96c27743-7503-41b8-abf0-87f55ec965e7\") " pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.072585 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.072461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v222d\" (UniqueName: \"kubernetes.io/projected/96c27743-7503-41b8-abf0-87f55ec965e7-kube-api-access-v222d\") pod \"must-gather-6ktx6\" (UID: \"96c27743-7503-41b8-abf0-87f55ec965e7\") " pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.152651 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.152604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" limit=1024 Jun 09 00:58:34.173581 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.173542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96c27743-7503-41b8-abf0-87f55ec965e7-must-gather-output\") pod \"must-gather-6ktx6\" (UID: \"96c27743-7503-41b8-abf0-87f55ec965e7\") " pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.173667 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.173593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v222d\" (UniqueName: \"kubernetes.io/projected/96c27743-7503-41b8-abf0-87f55ec965e7-kube-api-access-v222d\") pod \"must-gather-6ktx6\" (UID: \"96c27743-7503-41b8-abf0-87f55ec965e7\") " pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.173833 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.173818 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96c27743-7503-41b8-abf0-87f55ec965e7-must-gather-output\") pod \"must-gather-6ktx6\" (UID: \"96c27743-7503-41b8-abf0-87f55ec965e7\") " pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.180804 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.180782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v222d\" (UniqueName: \"kubernetes.io/projected/96c27743-7503-41b8-abf0-87f55ec965e7-kube-api-access-v222d\") pod \"must-gather-6ktx6\" (UID: \"96c27743-7503-41b8-abf0-87f55ec965e7\") " pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.357128 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.357066 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc7xn/must-gather-6ktx6" Jun 09 00:58:34.485626 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.485601 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc7xn/must-gather-6ktx6"] Jun 09 00:58:34.487890 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:58:34.487860 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96c27743_7503_41b8_abf0_87f55ec965e7.slice/crio-abb478462753a970e3d8e2fc888a624bf1e35756fd4280750940f9d0dece88c2 WatchSource:0}: Error finding container abb478462753a970e3d8e2fc888a624bf1e35756fd4280750940f9d0dece88c2: Status 404 returned error can't find the container with id abb478462753a970e3d8e2fc888a624bf1e35756fd4280750940f9d0dece88c2 Jun 09 00:58:34.490094 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:34.490076 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:58:35.328444 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:35.328391 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/must-gather-6ktx6" event={"ID":"96c27743-7503-41b8-abf0-87f55ec965e7","Type":"ContainerStarted","Data":"abb478462753a970e3d8e2fc888a624bf1e35756fd4280750940f9d0dece88c2"} Jun 09 00:58:36.336268 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:36.336237 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/must-gather-6ktx6" event={"ID":"96c27743-7503-41b8-abf0-87f55ec965e7","Type":"ContainerStarted","Data":"3c455d03244b51fd317c7b4bc9c991b22d9ea945e5ee63c639d5094b623954f6"} Jun 09 00:58:36.336725 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:36.336277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/must-gather-6ktx6" event={"ID":"96c27743-7503-41b8-abf0-87f55ec965e7","Type":"ContainerStarted","Data":"72429e53f5da4364ec14410be3705da4d37d09c29f289c3ae43f196908004af1"} Jun 09 00:58:36.351621 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:36.351575 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mc7xn/must-gather-6ktx6" podStartSLOduration=1.552084807 podStartE2EDuration="2.35154054s" totalImagesPullingTime="799.455733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:58:36.350497208 +0000 UTC m=+2328.398224660" watchObservedRunningTime="2026-06-09 00:58:36.35154054 +0000 UTC m=+2328.399268006" Jun 09 00:58:37.006192 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:37.006157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dw7jh_1060865b-3bc3-47ce-973c-d45197e42d2b/global-pull-secret-syncer/0.log" Jun 09 00:58:37.055904 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:37.055876 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dxfsd_48912ee2-aaaf-40bf-aa6e-c1cc1308f0fe/konnectivity-agent/0.log" Jun 09 00:58:37.160591 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:37.160536 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-224.ec2.internal_fc2317c6ca6ce2c8715a52a78254c178/haproxy/0.log" Jun 09 00:58:42.018165 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.018133 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q_e68646e1-e4c0-4274-b5e6-469d0a5923b3/extract/0.log" Jun 09 00:58:42.058069 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.058037 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q_e68646e1-e4c0-4274-b5e6-469d0a5923b3/util/0.log" Jun 09 00:58:42.079378 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.079347 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594gx6q_e68646e1-e4c0-4274-b5e6-469d0a5923b3/pull/0.log" Jun 09 00:58:42.109720 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.109690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm_5de55dc7-5ea7-4f38-a1bd-ab804fa1168f/extract/0.log" Jun 09 00:58:42.132022 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.131992 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm_5de55dc7-5ea7-4f38-a1bd-ab804fa1168f/util/0.log" Jun 09 00:58:42.151955 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.151922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z7gjm_5de55dc7-5ea7-4f38-a1bd-ab804fa1168f/pull/0.log" Jun 09 00:58:42.188217 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.188181 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp_d904901b-8997-4f6d-8a3d-8e6c34bc7ce4/extract/0.log" Jun 09 00:58:42.207861 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.207832 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp_d904901b-8997-4f6d-8a3d-8e6c34bc7ce4/util/0.log" Jun 09 00:58:42.227499 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.227470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qggsp_d904901b-8997-4f6d-8a3d-8e6c34bc7ce4/pull/0.log" Jun 09 00:58:42.251099 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.251069 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759_7fea35a8-be0c-4b65-ac83-f2e1b1791446/extract/0.log" Jun 09 00:58:42.270470 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.270367 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759_7fea35a8-be0c-4b65-ac83-f2e1b1791446/util/0.log" Jun 09 00:58:42.291700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.291673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17m759_7fea35a8-be0c-4b65-ac83-f2e1b1791446/pull/0.log" Jun 09 00:58:42.542338 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.542239 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7756866f56-x95rx_7942f8b6-a60b-409a-a5d3-62a74592b1aa/authorino/0.log" Jun 09 00:58:42.628885 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.628793 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7sgtv_9f02aa10-68d4-4cdf-863e-5c56bd7cedf6/manager/0.log" Jun 09 00:58:42.689890 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.689845 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cf5dq_3b7be235-53ba-4fd3-8102-0ddf22d40bcf/registry-server/0.log" Jun 09 00:58:42.789575 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:42.788429 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vlt4v_c8c11e21-4f9c-4857-a484-6fa4afef48c0/manager/0.log" Jun 09 00:58:44.173125 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.173082 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/alertmanager/0.log" Jun 09 00:58:44.200237 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.200201 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/config-reloader/0.log" Jun 09 00:58:44.223107 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.223061 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/kube-rbac-proxy-web/0.log" Jun 09 00:58:44.246572 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.246530 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/kube-rbac-proxy/0.log" Jun 09 00:58:44.270095 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.270063 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/kube-rbac-proxy-metric/0.log" Jun 09 00:58:44.289594 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.289540 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/prom-label-proxy/0.log" Jun 09 00:58:44.309602 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.309566 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e41cdd27-64be-4cfa-934d-9debecfe42b0/init-config-reloader/0.log" Jun 09 00:58:44.700057 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.700026 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkch8_3c1199d4-36c5-4883-a05f-4565d5d9df49/node-exporter/0.log" Jun 09 00:58:44.721431 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.721398 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkch8_3c1199d4-36c5-4883-a05f-4565d5d9df49/kube-rbac-proxy/0.log" Jun 09 00:58:44.743715 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.743641 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkch8_3c1199d4-36c5-4883-a05f-4565d5d9df49/init-textfile/0.log" Jun 09 00:58:44.767524 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.767492 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fx6fb_e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac/kube-rbac-proxy-main/0.log" Jun 09 00:58:44.788798 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.788765 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fx6fb_e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac/kube-rbac-proxy-self/0.log" Jun 09 00:58:44.811658 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:44.811626 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fx6fb_e89d3047-4d4e-4aa0-b4bd-93b2c2aa7fac/openshift-state-metrics/0.log" Jun 09 00:58:45.057132 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.057032 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-zs7wr_e076b570-2aef-4479-938d-02acd40d0ff1/prometheus-operator-admission-webhook/0.log" Jun 09 00:58:45.149342 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.149310 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766675688d-4pfm9_b17661a4-180f-4a67-af55-f080ebbd98c9/thanos-query/0.log" Jun 09 00:58:45.168295 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.168259 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766675688d-4pfm9_b17661a4-180f-4a67-af55-f080ebbd98c9/kube-rbac-proxy-web/0.log" Jun 09 00:58:45.188375 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.188345 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766675688d-4pfm9_b17661a4-180f-4a67-af55-f080ebbd98c9/kube-rbac-proxy/0.log" Jun 09 00:58:45.207183 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.207156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766675688d-4pfm9_b17661a4-180f-4a67-af55-f080ebbd98c9/prom-label-proxy/0.log" Jun 09 00:58:45.226646 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.226617 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766675688d-4pfm9_b17661a4-180f-4a67-af55-f080ebbd98c9/kube-rbac-proxy-rules/0.log" Jun 09 00:58:45.247968 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:45.247928 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766675688d-4pfm9_b17661a4-180f-4a67-af55-f080ebbd98c9/kube-rbac-proxy-metrics/0.log" Jun 09 00:58:46.967257 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:46.967229 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/1.log" Jun 09 00:58:46.974419 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:46.974389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-dhh58_544f31a5-e323-4667-9b70-3da7e45a10e4/console-operator/2.log" Jun 09 00:58:48.663896 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.663859 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8"] Jun 09 00:58:48.670883 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.670857 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.672739 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.672716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8"] Jun 09 00:58:48.739579 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.737203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-proc\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.739579 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.737278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-lib-modules\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.739579 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.737314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gscsz\" (UniqueName: \"kubernetes.io/projected/df530cd5-30ae-43a1-8f70-b5931ea305e4-kube-api-access-gscsz\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.739579 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.737362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-podres\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.739579 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.737394 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-sys\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.837924 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.837890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-lib-modules\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.837931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gscsz\" (UniqueName: \"kubernetes.io/projected/df530cd5-30ae-43a1-8f70-b5931ea305e4-kube-api-access-gscsz\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.837968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-podres\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.837991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-sys\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.838061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-proc\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838108 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.838098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-lib-modules\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.838127 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-sys\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.838140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-podres\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.838311 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.838157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df530cd5-30ae-43a1-8f70-b5931ea305e4-proc\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.846575 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.846535 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gscsz\" (UniqueName: \"kubernetes.io/projected/df530cd5-30ae-43a1-8f70-b5931ea305e4-kube-api-access-gscsz\") pod \"perf-node-gather-daemonset-djkw8\" (UID: \"df530cd5-30ae-43a1-8f70-b5931ea305e4\") " pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:48.992114 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:48.992021 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:49.198915 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.198863 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8"] Jun 09 00:58:49.205584 ip-10-0-140-224 kubenswrapper[2572]: W0609 00:58:49.205518 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf530cd5_30ae_43a1_8f70_b5931ea305e4.slice/crio-a60b73066a8901b55ef40b5d35ed1a2ef36714a271c1ad318f5789b139459d50 WatchSource:0}: Error finding container a60b73066a8901b55ef40b5d35ed1a2ef36714a271c1ad318f5789b139459d50: Status 404 returned error can't find the container with id a60b73066a8901b55ef40b5d35ed1a2ef36714a271c1ad318f5789b139459d50 Jun 09 00:58:49.451032 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.450997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" event={"ID":"df530cd5-30ae-43a1-8f70-b5931ea305e4","Type":"ContainerStarted","Data":"5e562fd0e8923de5bbd4bfcb36a9d765b3e28cb6bcd9f2e2b50a5adfec765576"} Jun 09 00:58:49.451196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.451047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" event={"ID":"df530cd5-30ae-43a1-8f70-b5931ea305e4","Type":"ContainerStarted","Data":"a60b73066a8901b55ef40b5d35ed1a2ef36714a271c1ad318f5789b139459d50"} Jun 09 00:58:49.451196 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.451184 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:49.469441 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.469380 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" podStartSLOduration=1.469362214 podStartE2EDuration="1.469362214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:58:49.465735817 +0000 UTC m=+2341.513463246" watchObservedRunningTime="2026-06-09 00:58:49.469362214 +0000 UTC m=+2341.517089652" Jun 09 00:58:49.619227 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.619139 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crtmw_3f27364c-dd01-416e-832f-0f135f67c686/dns/0.log" Jun 09 00:58:49.637014 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.636988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crtmw_3f27364c-dd01-416e-832f-0f135f67c686/kube-rbac-proxy/0.log" Jun 09 00:58:49.678307 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:49.678283 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7nxx4_f48eec7d-aad5-4e92-8ecf-8b8f7b9b9f2e/dns-node-resolver/0.log" Jun 09 00:58:50.204832 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:50.204802 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cd49848c-d4b45_0312a2c2-2dd2-474a-bf39-3a6d4a7b3373/registry/0.log" Jun 09 00:58:50.225829 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:50.225798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-65qx9_22cbcf86-045d-44a1-83eb-8e72075b34ec/node-ca/0.log" Jun 09 00:58:51.143725 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:51.143694 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pcwfd_a4ad282a-0cf9-41e1-b685-81f7c1302fea/istio-proxy/0.log" Jun 09 00:58:51.283032 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:51.282997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/0.log" Jun 09 00:58:51.355888 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:51.355839 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/1.log" Jun 09 00:58:51.929076 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:51.929047 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mm2kn_fe5c5b78-815b-4253-9117-86114688727a/serve-healthcheck-canary/0.log" Jun 09 00:58:52.459714 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:52.459682 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6g5jv_58178691-8892-4cee-8b61-ab7a5ccbd191/kube-rbac-proxy/0.log" Jun 09 00:58:52.479809 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:52.479781 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6g5jv_58178691-8892-4cee-8b61-ab7a5ccbd191/exporter/0.log" Jun 09 00:58:52.498807 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:52.498782 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6g5jv_58178691-8892-4cee-8b61-ab7a5ccbd191/extractor/0.log" Jun 09 00:58:54.632350 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:54.632312 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64c7bc99c9-kqdtd_4ad0d4c2-82c1-4e1a-a896-5cc84dca719e/nginx/0.log" Jun 09 00:58:55.128749 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:55.128721 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-8l48b_933b11b1-b3e2-4ce2-84ca-335488d23a44/manager/0.log" Jun 09 00:58:55.143509 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:55.143484 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cffbb876-8l48b_933b11b1-b3e2-4ce2-84ca-335488d23a44/copy-manifests/0.log" Jun 09 00:58:55.469774 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:55.469739 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mc7xn/perf-node-gather-daemonset-djkw8" Jun 09 00:58:56.590982 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:58:56.590955 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d64774465-6tdt5_a601febb-6a98-451f-933a-74c779fd40c7/manager/0.log" Jun 09 00:59:00.803782 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:00.803704 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pcwfd_a4ad282a-0cf9-41e1-b685-81f7c1302fea/istio-proxy/0.log" Jun 09 00:59:00.938608 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:00.938578 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/0.log" Jun 09 00:59:01.007425 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:01.007392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/1.log" Jun 09 00:59:02.064517 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:02.064478 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pcwfd_a4ad282a-0cf9-41e1-b685-81f7c1302fea/istio-proxy/0.log" Jun 09 00:59:02.179700 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:02.179668 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/0.log" Jun 09 00:59:02.249549 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:02.249503 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/1.log" Jun 09 00:59:03.580359 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.580335 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/kube-multus-additional-cni-plugins/0.log" Jun 09 00:59:03.598847 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.598820 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/egress-router-binary-copy/0.log" Jun 09 00:59:03.622876 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.622853 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/cni-plugins/0.log" Jun 09 00:59:03.642797 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.642770 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/bond-cni-plugin/0.log" Jun 09 00:59:03.660998 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.660968 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/routeoverride-cni/0.log" Jun 09 00:59:03.679578 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.679533 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/whereabouts-cni-bincopy/0.log" Jun 09 00:59:03.697378 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.697354 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6mhg_8f356eeb-335f-4b25-82ac-25b7877fd130/whereabouts-cni/0.log" Jun 09 00:59:03.821459 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.821426 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pcwfd_a4ad282a-0cf9-41e1-b685-81f7c1302fea/istio-proxy/0.log" Jun 09 00:59:03.921104 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.921055 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/0.log" Jun 09 00:59:03.944575 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.944526 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rh9f6_020faf34-5d48-42ae-bc2d-3a77d16cfc19/kube-multus/0.log" Jun 09 00:59:03.972736 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.972710 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7gn4s_b8681e4f-fd46-4459-a758-86bd8e59af0b/network-metrics-daemon/0.log" Jun 09 00:59:03.988514 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:03.988492 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7gn4s_b8681e4f-fd46-4459-a758-86bd8e59af0b/kube-rbac-proxy/0.log" Jun 09 00:59:04.004317 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:04.004296 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfgsz_5c299396-1c5b-444a-bebf-d27a6f4b3ab2/istio-proxy/1.log" Jun 09 00:59:05.415899 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.415871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-controller/0.log" Jun 09 00:59:05.433863 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.433801 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/1.log" Jun 09 00:59:05.433863 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.433836 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovn-acl-logging/0.log" Jun 09 00:59:05.455011 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.454980 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/kube-rbac-proxy-node/0.log" Jun 09 00:59:05.476241 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.476216 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 00:59:05.491186 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.491138 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/northd/0.log" Jun 09 00:59:05.509326 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.509297 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/nbdb/0.log" Jun 09 00:59:05.527016 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.526931 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/sbdb/0.log" Jun 09 00:59:05.597620 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.597516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qm6wc_9885d60f-1288-4a8c-a778-84ac139ae7ea/ovnkube-controller/0.log" Jun 09 00:59:05.939235 ip-10-0-140-224 kubenswrapper[2572]: I0609 00:59:05.939202 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pcwfd_a4ad282a-0cf9-41e1-b685-81f7c1302fea/istio-proxy/0.log"