May 28 18:26:00.206829 ip-10-0-140-205 systemd[1]: Starting Kubernetes Kubelet... May 28 18:26:00.674264 ip-10-0-140-205 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 18:26:00.674264 ip-10-0-140-205 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 18:26:00.674264 ip-10-0-140-205 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 18:26:00.674264 ip-10-0-140-205 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 18:26:00.674264 ip-10-0-140-205 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 18:26:00.675905 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.675819 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 18:26:00.679811 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679791 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:00.679811 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679808 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:00.679811 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679812 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:00.679811 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679818 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679822 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679828 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679832 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679836 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679839 2559 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679843 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679846 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679850 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679854 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679858 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679862 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679866 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679878 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679882 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679888 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679895 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679902 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679906 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:00.680063 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679911 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679915 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679919 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679924 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679928 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679932 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679936 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679940 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679944 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679950 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679954 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679958 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679962 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679966 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679971 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679977 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679981 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679985 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679990 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:00.680718 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679994 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.679998 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680003 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680007 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680011 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680015 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680019 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680023 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680028 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680032 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680036 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680040 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680046 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680050 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680054 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680058 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680062 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680066 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680071 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680075 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:00.681302 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680079 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680082 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680094 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680101 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680106 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680110 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680114 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680119 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680123 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680128 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680132 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680135 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680139 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680143 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680148 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680152 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680156 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680160 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680164 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680168 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:00.682104 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680172 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680177 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680182 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680187 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.680191 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681483 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681495 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681501 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681507 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681512 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681516 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681520 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681525 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681529 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681551 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681556 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681561 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681566 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681570 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681575 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:00.682622 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681580 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681584 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681589 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681592 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681597 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681601 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681606 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681610 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681615 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681619 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681623 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681627 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681631 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681638 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681644 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681649 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681653 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681657 2559 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681663 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681667 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:00.683435 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681671 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681675 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681679 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681683 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681688 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681692 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681696 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681701 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681705 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681709 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681713 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681719 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681724 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681728 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681732 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681737 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681741 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681745 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681750 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681754 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:00.684269 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681758 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681762 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681766 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681771 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681774 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681778 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681784 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681788 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681792 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681798 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681806 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681811 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681816 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681820 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681824 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681829 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681833 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681839 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681844 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:00.684785 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681848 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681853 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681857 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681862 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681866 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681870 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681875 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681879 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681883 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681887 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681891 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.681895 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682710 2559 flags.go:64] FLAG: --address="0.0.0.0" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682731 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682746 2559 flags.go:64] FLAG: --anonymous-auth="true" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682753 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682759 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682765 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682771 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682779 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682785 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 18:26:00.685323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682791 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682797 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682802 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682807 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682812 2559 flags.go:64] FLAG: --cgroup-root="" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682817 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682822 2559 flags.go:64] FLAG: --client-ca-file="" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682827 2559 flags.go:64] FLAG: --cloud-config="" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682832 2559 flags.go:64] FLAG: --cloud-provider="external" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682837 2559 flags.go:64] FLAG: --cluster-dns="[]" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682843 2559 flags.go:64] FLAG: --cluster-domain="" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682848 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682853 2559 flags.go:64] FLAG: --config-dir="" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682858 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682863 2559 flags.go:64] FLAG: --container-log-max-files="5" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682870 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682875 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682880 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682885 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682890 2559 flags.go:64] FLAG: --contention-profiling="false" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682894 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682899 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682904 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682909 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682916 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 18:26:00.686061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682921 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682926 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682931 2559 flags.go:64] FLAG: --enable-load-reader="false" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682936 2559 flags.go:64] FLAG: --enable-server="true" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682940 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682948 2559 flags.go:64] FLAG: --event-burst="100" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682953 2559 flags.go:64] FLAG: --event-qps="50" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682959 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682965 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682970 2559 flags.go:64] FLAG: --eviction-hard="" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682976 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682981 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682985 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682991 2559 flags.go:64] FLAG: --eviction-soft="" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.682996 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683001 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683005 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683010 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683015 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683020 2559 flags.go:64] FLAG: --fail-swap-on="true" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683025 2559 flags.go:64] FLAG: --feature-gates="" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683031 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683059 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683067 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683072 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683078 2559 flags.go:64] FLAG: --healthz-port="10248" May 28 18:26:00.686728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683083 2559 flags.go:64] FLAG: --help="false" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683088 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-140-205.ec2.internal" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683093 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683098 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683103 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683109 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683115 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683120 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683124 2559 flags.go:64] FLAG: --image-service-endpoint="" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683129 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683134 2559 flags.go:64] FLAG: --kube-api-burst="100" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683139 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683145 2559 flags.go:64] FLAG: --kube-api-qps="50" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683150 2559 flags.go:64] FLAG: --kube-reserved="" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683155 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683160 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683165 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683170 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683174 2559 flags.go:64] FLAG: --lock-file="" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683179 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683185 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683190 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683199 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 28 18:26:00.687440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683204 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683209 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683214 2559 flags.go:64] FLAG: --logging-format="text" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683218 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683224 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683229 2559 flags.go:64] FLAG: --manifest-url="" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683233 2559 flags.go:64] FLAG: --manifest-url-header="" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683241 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683246 2559 flags.go:64] FLAG: --max-open-files="1000000" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683252 2559 flags.go:64] FLAG: --max-pods="110" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683257 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683262 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683267 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683271 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683276 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683282 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683286 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683298 2559 flags.go:64] FLAG: --node-status-max-images="50" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683303 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683308 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683313 2559 flags.go:64] FLAG: --pod-cidr="" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683318 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683328 2559 flags.go:64] FLAG: --pod-manifest-path="" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683333 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 28 18:26:00.688060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683339 2559 flags.go:64] FLAG: --pods-per-core="0" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683344 2559 flags.go:64] FLAG: --port="10250" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683349 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683353 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ea73219b9aa62b6b" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683359 2559 flags.go:64] FLAG: --qos-reserved="" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683364 2559 flags.go:64] FLAG: --read-only-port="10255" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683369 2559 flags.go:64] FLAG: --register-node="true" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683374 2559 flags.go:64] FLAG: --register-schedulable="true" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683378 2559 flags.go:64] FLAG: --register-with-taints="" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683389 2559 flags.go:64] FLAG: --registry-burst="10" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683394 2559 flags.go:64] FLAG: --registry-qps="5" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683399 2559 flags.go:64] FLAG: --reserved-cpus="" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683404 2559 flags.go:64] FLAG: --reserved-memory="" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683409 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683415 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683420 2559 flags.go:64] FLAG: --rotate-certificates="false" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683425 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683429 2559 flags.go:64] FLAG: --runonce="false" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683434 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683439 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683444 2559 flags.go:64] FLAG: --seccomp-default="false" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683448 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683453 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683458 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683463 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683468 2559 flags.go:64] FLAG: --storage-driver-password="root" May 28 18:26:00.688664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683472 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683482 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683487 2559 flags.go:64] FLAG: --storage-driver-user="root" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683492 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683497 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683502 2559 flags.go:64] FLAG: --system-cgroups="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683507 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683517 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683522 2559 flags.go:64] FLAG: --tls-cert-file="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683527 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683552 2559 flags.go:64] FLAG: --tls-min-version="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683557 2559 flags.go:64] FLAG: --tls-private-key-file="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683562 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683567 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683571 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683576 2559 flags.go:64] FLAG: --v="2" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683583 2559 flags.go:64] FLAG: --version="false" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683589 2559 flags.go:64] FLAG: --vmodule="" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683595 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.683600 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683749 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683755 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683760 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683764 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:00.689307 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683770 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683775 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683780 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683784 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683788 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683793 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683797 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683802 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683806 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683812 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683816 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683821 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683825 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683829 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683833 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683837 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683842 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683847 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683852 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683856 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:00.689950 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683860 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683864 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683869 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683873 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683878 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683881 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683888 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683893 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683898 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683902 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683906 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683911 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683915 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683920 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683924 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683928 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683932 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683936 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683940 2559 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:00.690494 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683944 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683948 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683954 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683958 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683965 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683971 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683977 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683982 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683987 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683991 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.683996 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684001 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684005 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684010 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684014 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684018 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684022 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684026 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684030 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:00.691249 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684034 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684039 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684044 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684048 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684052 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684056 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684060 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684064 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684068 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684072 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684077 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684081 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684094 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684098 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684102 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684108 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684112 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684117 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684121 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684125 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:00.691771 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684129 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684133 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684138 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.684142 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.684811 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.692162 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.692179 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692225 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692231 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692235 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692238 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692241 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692244 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692247 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692250 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692253 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:00.692268 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692255 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692258 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692261 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692263 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692266 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692269 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692271 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692274 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692277 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692280 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692283 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692285 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692288 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692291 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692293 2559 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692296 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692298 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692302 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692305 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692307 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:00.692752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692310 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692313 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692315 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692318 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692321 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692323 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692326 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692328 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692331 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692335 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692339 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692342 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692344 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692347 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692350 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692352 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692355 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692358 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692360 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:00.693274 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692364 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692366 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692369 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692372 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692374 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692376 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692379 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692382 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692384 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692387 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692389 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692392 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692395 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692397 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692400 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692403 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692405 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692408 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692410 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692413 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:00.693752 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692416 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692418 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692421 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692424 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692426 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692429 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692431 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692434 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692437 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692440 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692442 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692445 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692448 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692450 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692454 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692459 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692461 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:00.694234 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692464 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.692469 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692573 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692578 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692581 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692584 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692587 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692590 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692592 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692595 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692598 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692601 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692603 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692606 2559 feature_gate.go:328] unrecognized feature gate: Example May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692608 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692611 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 18:26:00.694665 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692614 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692616 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692619 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692622 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692624 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692627 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692630 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692633 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692639 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692642 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692645 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692649 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692651 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692654 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692656 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692659 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692662 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692664 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692667 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692670 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 18:26:00.695068 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692673 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692675 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692678 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692680 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692684 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692687 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692690 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692693 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692695 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692698 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692700 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692703 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692705 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692708 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692710 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692713 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692716 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692719 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692722 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 18:26:00.695568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692724 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692727 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692730 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692733 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692735 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692738 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692740 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692743 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692746 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692748 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692751 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692753 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692756 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692759 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692761 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692764 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692767 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692769 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692772 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692774 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 18:26:00.696027 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692778 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692782 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692785 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692788 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692791 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692794 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692797 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692799 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692802 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692805 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692807 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692810 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:00.692812 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.692817 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 18:26:00.696563 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.693614 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 28 18:26:00.700369 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.700355 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 18:26:00.701462 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.701452 2559 server.go:1019] "Starting client certificate rotation" May 28 18:26:00.701599 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.701560 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 18:26:00.701599 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.701593 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 18:26:00.728580 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.728564 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 18:26:00.732972 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.732955 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 18:26:00.750376 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.750358 2559 log.go:25] "Validated CRI v1 runtime API" May 28 18:26:00.755740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.755723 2559 log.go:25] "Validated CRI v1 image API" May 28 18:26:00.758721 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.758705 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 18:26:00.762168 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.762149 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 18:26:00.763560 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.763524 2559 fs.go:135] Filesystem UUIDs: map[0a568c1d-7ff1-49f7-80b6-69965671c78e:/dev/nvme0n1p3 1d789350-4db5-4e0e-a7e8-99a2afe66b3d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 28 18:26:00.763628 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.763558 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 18:26:00.767928 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.767821 2559 manager.go:217] Machine: {Timestamp:2026-05-28 18:26:00.767316406 +0000 UTC m=+0.441452012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098291 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad5dc74bdd29d15284b34b036e200 SystemUUID:ec2ad5dc-74bd-d29d-1528-4b34b036e200 BootID:21b17a3c-1e92-4881-9552-2ab67044a9e7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:ea:18:de:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:ea:18:de:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:18:64:77:8e:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 18:26:00.767928 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.767923 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 18:26:00.768050 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.767996 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 18:26:00.769937 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.769908 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 18:26:00.770069 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.769939 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 18:26:00.770117 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.770081 2559 topology_manager.go:138] "Creating topology manager with none policy" May 28 18:26:00.770117 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.770088 2559 container_manager_linux.go:306] "Creating device plugin manager" May 28 18:26:00.770117 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.770095 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 18:26:00.770117 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.770105 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 18:26:00.771393 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.771384 2559 state_mem.go:36] "Initialized new in-memory state store" May 28 18:26:00.771493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.771484 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 18:26:00.774015 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.774005 2559 kubelet.go:491] "Attempting to sync node with API server" May 28 18:26:00.774060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.774018 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 18:26:00.774060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.774030 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 18:26:00.774060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.774038 2559 kubelet.go:397] "Adding apiserver pod source" May 28 18:26:00.774060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.774047 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 18:26:00.775186 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.775174 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 18:26:00.775252 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.775192 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 18:26:00.778284 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.778259 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 18:26:00.780030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780016 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 18:26:00.780896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780876 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 18:26:00.780896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780892 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 18:26:00.780896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780899 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780907 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780915 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780921 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780927 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780932 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780938 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780944 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 18:26:00.781014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.780952 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 18:26:00.781425 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.781414 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 18:26:00.783059 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.783042 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-njb6x" May 28 18:26:00.783323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.783312 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 18:26:00.783375 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.783326 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 18:26:00.784737 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.784712 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 18:26:00.784790 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.784712 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 18:26:00.786729 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.786716 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 18:26:00.786787 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.786754 2559 server.go:1295] "Started kubelet" May 28 18:26:00.786898 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.786859 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 18:26:00.786949 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.786921 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 18:26:00.787428 ip-10-0-140-205 systemd[1]: Started Kubernetes Kubelet. May 28 18:26:00.787891 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.787662 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 18:26:00.788216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.788042 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 18:26:00.788763 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.788728 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-njb6x" May 28 18:26:00.788996 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.788979 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 18:26:00.793093 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.793078 2559 server.go:317] "Adding debug handlers to kubelet server" May 28 18:26:00.795195 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.795056 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 18:26:00.795707 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.795686 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 18:26:00.795969 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.795947 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 18:26:00.796032 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.795971 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 18:26:00.799181 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.799139 2559 reconstruct.go:97] "Volume reconstruction finished" May 28 18:26:00.799181 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.799179 2559 reconciler.go:26] "Reconciler: start to sync state" May 28 18:26:00.799339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.799325 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 18:26:00.800174 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.800154 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:00.800267 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800232 2559 factory.go:55] Registering systemd factory May 28 18:26:00.800267 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800247 2559 factory.go:223] Registration of the systemd container factory successfully May 28 18:26:00.800503 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.800483 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 18:26:00.800657 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800643 2559 factory.go:153] Registering CRI-O factory May 28 18:26:00.800732 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800660 2559 factory.go:223] Registration of the crio container factory successfully May 28 18:26:00.800732 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800718 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 18:26:00.800820 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800742 2559 factory.go:103] Registering Raw factory May 28 18:26:00.800820 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.800758 2559 manager.go:1196] Started watching for new ooms in manager May 28 18:26:00.801619 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.801598 2559 manager.go:319] Starting recovery of all containers May 28 18:26:00.804913 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.804895 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-205.ec2.internal\" not found" node="ip-10-0-140-205.ec2.internal" May 28 18:26:00.806795 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.806774 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:00.814065 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.813914 2559 manager.go:324] Recovery completed May 28 18:26:00.818146 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.818134 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:00.820122 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.820107 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:00.820207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.820134 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:00.820207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.820144 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:00.820656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.820642 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 18:26:00.820656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.820654 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 18:26:00.820752 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.820670 2559 state_mem.go:36] "Initialized new in-memory state store" May 28 18:26:00.823182 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.823172 2559 policy_none.go:49] "None policy: Start" May 28 18:26:00.823220 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.823186 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 18:26:00.823220 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.823197 2559 state_mem.go:35] "Initializing new in-memory state store" May 28 18:26:00.869114 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869100 2559 manager.go:341] "Starting Device Plugin manager" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.869130 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869139 2559 server.go:85] "Starting device plugin registration server" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869338 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869351 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869435 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869528 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.869556 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.870141 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 18:26:00.872986 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.870191 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:00.927502 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.927428 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 18:26:00.928625 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.928599 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 18:26:00.928710 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.928637 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 18:26:00.928710 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.928659 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 18:26:00.928710 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.928669 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 28 18:26:00.928844 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.928713 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 18:26:00.932139 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.932123 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:00.970135 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.970116 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:00.971178 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.971164 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:00.971253 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.971190 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:00.971253 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.971216 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:00.971253 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.971241 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-205.ec2.internal" May 28 18:26:00.980332 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:00.980318 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-205.ec2.internal" May 28 18:26:00.980373 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.980338 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-205.ec2.internal\": node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:00.995457 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:00.995437 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.028826 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.028795 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal"] May 28 18:26:01.028897 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.028874 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:01.030330 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.030316 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:01.030389 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.030342 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:01.030389 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.030355 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:01.031697 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.031685 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:01.031937 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.031923 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.031976 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.031957 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:01.032426 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.032402 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:01.032426 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.032419 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:01.032596 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.032439 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:01.032596 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.032444 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:01.032596 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.032459 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:01.032596 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.032461 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:01.033712 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.033695 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" May 28 18:26:01.033802 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.033720 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 18:26:01.034425 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.034408 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientMemory" May 28 18:26:01.034519 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.034430 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasNoDiskPressure" May 28 18:26:01.034519 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.034442 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeHasSufficientPID" May 28 18:26:01.054065 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.054046 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-205.ec2.internal\" not found" node="ip-10-0-140-205.ec2.internal" May 28 18:26:01.057357 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.057333 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-205.ec2.internal\" not found" node="ip-10-0-140-205.ec2.internal" May 28 18:26:01.096329 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.096312 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.100213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.100195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff221295619ed8276ba0a0150a60f476-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal\" (UID: \"ff221295619ed8276ba0a0150a60f476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.100275 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.100221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff221295619ed8276ba0a0150a60f476-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal\" (UID: \"ff221295619ed8276ba0a0150a60f476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.100275 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.100236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/273fe7d67b284666b129c476e57124bd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-205.ec2.internal\" (UID: \"273fe7d67b284666b129c476e57124bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" May 28 18:26:01.197360 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.197279 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.200614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.200595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff221295619ed8276ba0a0150a60f476-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal\" (UID: \"ff221295619ed8276ba0a0150a60f476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.200702 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.200633 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff221295619ed8276ba0a0150a60f476-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal\" (UID: \"ff221295619ed8276ba0a0150a60f476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.200702 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.200681 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff221295619ed8276ba0a0150a60f476-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal\" (UID: \"ff221295619ed8276ba0a0150a60f476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.200803 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.200710 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/273fe7d67b284666b129c476e57124bd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-205.ec2.internal\" (UID: \"273fe7d67b284666b129c476e57124bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" May 28 18:26:01.200803 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.200760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff221295619ed8276ba0a0150a60f476-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal\" (UID: \"ff221295619ed8276ba0a0150a60f476\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.200803 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.200758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/273fe7d67b284666b129c476e57124bd-config\") pod \"kube-apiserver-proxy-ip-10-0-140-205.ec2.internal\" (UID: \"273fe7d67b284666b129c476e57124bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" May 28 18:26:01.297896 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.297863 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.357269 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.357247 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:01.360064 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.360045 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" May 28 18:26:01.398794 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.398762 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.499236 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.499161 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.599619 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.599575 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.699968 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.699935 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.701046 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.701028 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 18:26:01.701171 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.701156 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 18:26:01.701209 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.701182 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 18:26:01.790368 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.790258 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 18:21:00 +0000 UTC" deadline="2028-01-07 15:36:29.928531067 +0000 UTC" May 28 18:26:01.790368 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.790303 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14133h10m28.138232664s" May 28 18:26:01.795798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.795777 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 18:26:01.800126 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.800102 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.810831 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.810806 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 18:26:01.840618 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.840593 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qnhqw" May 28 18:26:01.847844 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.847825 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qnhqw" May 28 18:26:01.900470 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:01.900449 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-205.ec2.internal\" not found" May 28 18:26:01.909116 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:01.909084 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff221295619ed8276ba0a0150a60f476.slice/crio-2128421340f6e55f9dc607e545524acd00935cae5c9814d87f7a7117a03c6302 WatchSource:0}: Error finding container 2128421340f6e55f9dc607e545524acd00935cae5c9814d87f7a7117a03c6302: Status 404 returned error can't find the container with id 2128421340f6e55f9dc607e545524acd00935cae5c9814d87f7a7117a03c6302 May 28 18:26:01.909400 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:01.909376 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273fe7d67b284666b129c476e57124bd.slice/crio-87768a913b1fb62895250a380da9ba79a9ed2fdeda4cb15dfa2298b7c985ebc1 WatchSource:0}: Error finding container 87768a913b1fb62895250a380da9ba79a9ed2fdeda4cb15dfa2298b7c985ebc1: Status 404 returned error can't find the container with id 87768a913b1fb62895250a380da9ba79a9ed2fdeda4cb15dfa2298b7c985ebc1 May 28 18:26:01.912308 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.912292 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:26:01.932032 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.931973 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" event={"ID":"ff221295619ed8276ba0a0150a60f476","Type":"ContainerStarted","Data":"2128421340f6e55f9dc607e545524acd00935cae5c9814d87f7a7117a03c6302"} May 28 18:26:01.932888 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.932865 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" event={"ID":"273fe7d67b284666b129c476e57124bd","Type":"ContainerStarted","Data":"87768a913b1fb62895250a380da9ba79a9ed2fdeda4cb15dfa2298b7c985ebc1"} May 28 18:26:01.972666 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.972646 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:01.999959 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:01.999941 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" May 28 18:26:02.016031 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.016011 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 18:26:02.018233 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.018220 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" May 28 18:26:02.027096 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.027084 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 18:26:02.157168 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.157118 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:02.774774 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.774730 2559 apiserver.go:52] "Watching apiserver" May 28 18:26:02.775443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.774802 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:02.781643 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.781614 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 18:26:02.782004 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.781979 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z2m5p","openshift-network-operator/iptables-alerter-s9gsn","openshift-ovn-kubernetes/ovnkube-node-fnrhm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps","openshift-dns/node-resolver-2ppnf","openshift-image-registry/node-ca-w9kwh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal","openshift-multus/multus-additional-cni-plugins-mhwxh","openshift-multus/multus-n27xn","openshift-multus/network-metrics-daemon-zqnxr","openshift-network-diagnostics/network-check-target-jqmtt","kube-system/konnectivity-agent-2s5fv"] May 28 18:26:02.784804 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.784784 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:02.784920 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.784900 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:02.785824 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.785804 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.785939 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.785877 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.787299 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.787215 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.788609 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.788588 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 18:26:02.788906 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.788884 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-42m8h\"" May 28 18:26:02.789585 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.789426 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 18:26:02.789585 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.789582 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.789736 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.789650 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 18:26:02.789736 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.789716 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.790775 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.790754 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpjtk\"" May 28 18:26:02.790874 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.790793 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 18:26:02.790925 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.790917 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 18:26:02.791437 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.791413 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.793008 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.792926 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n27xn" May 28 18:26:02.793702 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.793683 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 18:26:02.793794 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.793725 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2ltts\"" May 28 18:26:02.794030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794014 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 18:26:02.794097 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794036 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 18:26:02.794097 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794076 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 18:26:02.794189 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794140 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 18:26:02.794189 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794161 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 18:26:02.794551 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794289 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 18:26:02.794551 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794372 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 18:26:02.794551 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794452 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 18:26:02.794740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794677 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk2td\"" May 28 18:26:02.794740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794735 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 18:26:02.796039 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794896 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 18:26:02.796039 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794948 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 18:26:02.796039 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.794985 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 18:26:02.796039 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.795277 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-snlb2\"" May 28 18:26:02.796426 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.796394 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.796608 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.796576 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:02.796693 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.796645 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:02.797712 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.797689 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4z5p\"" May 28 18:26:02.798383 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.798333 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.799241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.798945 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 18:26:02.799241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.799010 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 18:26:02.799241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.799094 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 18:26:02.799241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.799108 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 18:26:02.799241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.799146 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 18:26:02.799463 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.799370 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ksrm9\"" May 28 18:26:02.800339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.800322 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 18:26:02.800864 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.800841 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 18:26:02.801832 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.801811 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 18:26:02.802168 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.802155 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 18:26:02.802658 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.802637 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cmspv\"" May 28 18:26:02.802906 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.802888 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kktnp\"" May 28 18:26:02.803027 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.802939 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 18:26:02.810282 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-device-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.810387 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-sys-fs\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.810387 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-var-lib-kubelet\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.810387 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-etc-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.810387 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-daemon-config\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.810611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-system-cni-dir\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.810611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08f2bdf5-941c-4cd5-981d-9bab5f883783-iptables-alerter-script\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.810611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-ovnkube-config\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.810611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysconfig\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.810611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysctl-conf\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-lib-modules\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-run-netns\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-ovn\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccb2702a-5877-47da-8034-dc390fc78f2a-ovn-node-metrics-cert\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-cni-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-cni-multus\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:02.810847 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-modprobe-d\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-etc-selinux\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf9rf\" (UniqueName: \"kubernetes.io/projected/08f2bdf5-941c-4cd5-981d-9bab5f883783-kube-api-access-pf9rf\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-var-lib-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-node-log\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-socket-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rh2\" (UniqueName: \"kubernetes.io/projected/9f3ac370-b9ff-4616-8d6c-bed30d173359-kube-api-access-j2rh2\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-multus-certs\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-slash\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.810993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c13f4aed-1d67-4672-8f6e-047dbd11d42c-tmp\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8694db8a-a823-46f9-9b48-40607fd63f11-agent-certs\") pod \"konnectivity-agent-2s5fv\" (UID: \"8694db8a-a823-46f9-9b48-40607fd63f11\") " pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08f2bdf5-941c-4cd5-981d-9bab5f883783-host-slash\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.811216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-cni-bin\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-run\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-cni-netd\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-os-release\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cnibin\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysctl-d\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-host\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-cni-bin\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-kubelet\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811423 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmw9n\" (UniqueName: \"kubernetes.io/projected/c13f4aed-1d67-4672-8f6e-047dbd11d42c-kube-api-access-lmw9n\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-ovnkube-script-lib\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-system-cni-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c561b3ab-660e-41dc-bc03-69103e70e7ae-cni-binary-copy\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-k8s-cni-cncf-io\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsbzj\" (UniqueName: \"kubernetes.io/projected/f00a9ddf-54b4-4627-9009-1cdd4e57125d-kube-api-access-bsbzj\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:02.811986 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-os-release\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-sys\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75d1d08d-4455-4a3a-ab83-db075f4101eb-serviceca\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-kubelet\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b41acff3-0ece-4328-843a-2bc8edcf41e7-tmp-dir\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8694db8a-a823-46f9-9b48-40607fd63f11-konnectivity-ca\") pod \"konnectivity-agent-2s5fv\" (UID: \"8694db8a-a823-46f9-9b48-40607fd63f11\") " pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811762 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5dm\" (UniqueName: \"kubernetes.io/projected/75d1d08d-4455-4a3a-ab83-db075f4101eb-kube-api-access-4g5dm\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-log-socket\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-socket-dir-parent\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-netns\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b41acff3-0ece-4328-843a-2bc8edcf41e7-hosts-file\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-kubernetes\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-systemd\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.811951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-env-overrides\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zcnn\" (UniqueName: \"kubernetes.io/projected/b41acff3-0ece-4328-843a-2bc8edcf41e7-kube-api-access-2zcnn\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.812934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h749\" (UniqueName: \"kubernetes.io/projected/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-kube-api-access-6h749\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75d1d08d-4455-4a3a-ab83-db075f4101eb-host\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812290 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k888b\" (UniqueName: \"kubernetes.io/projected/ccb2702a-5877-47da-8034-dc390fc78f2a-kube-api-access-k888b\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-cnibin\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-conf-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhrq\" (UniqueName: \"kubernetes.io/projected/c561b3ab-660e-41dc-bc03-69103e70e7ae-kube-api-access-zlhrq\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-systemd-units\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-systemd\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-registration-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-hostroot\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-etc-kubernetes\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.813641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.812629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-tuned\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.848597 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.848570 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:01 +0000 UTC" deadline="2028-01-21 16:34:00.086081015 +0000 UTC" May 28 18:26:02.848692 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.848598 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14470h7m57.237486496s" May 28 18:26:02.849706 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.849688 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 18:26:02.913854 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913814 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-system-cni-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.913854 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c561b3ab-660e-41dc-bc03-69103e70e7ae-cni-binary-copy\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914035 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913879 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-k8s-cni-cncf-io\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914035 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-system-cni-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914035 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913917 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsbzj\" (UniqueName: \"kubernetes.io/projected/f00a9ddf-54b4-4627-9009-1cdd4e57125d-kube-api-access-bsbzj\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:02.914035 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913971 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-os-release\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.914035 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913988 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-k8s-cni-cncf-io\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914053 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-sys\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914053 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-os-release\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.913993 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-sys\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914093 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75d1d08d-4455-4a3a-ab83-db075f4101eb-serviceca\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914119 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-kubelet\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914144 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b41acff3-0ece-4328-843a-2bc8edcf41e7-tmp-dir\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914167 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8694db8a-a823-46f9-9b48-40607fd63f11-konnectivity-ca\") pod \"konnectivity-agent-2s5fv\" (UID: \"8694db8a-a823-46f9-9b48-40607fd63f11\") " pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914192 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5dm\" (UniqueName: \"kubernetes.io/projected/75d1d08d-4455-4a3a-ab83-db075f4101eb-kube-api-access-4g5dm\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.914244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914214 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-log-socket\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914253 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-socket-dir-parent\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914278 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-netns\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914300 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b41acff3-0ece-4328-843a-2bc8edcf41e7-hosts-file\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914325 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-kubernetes\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914348 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-systemd\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914370 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-env-overrides\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-log-socket\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zcnn\" (UniqueName: \"kubernetes.io/projected/b41acff3-0ece-4328-843a-2bc8edcf41e7-kube-api-access-2zcnn\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914425 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-kubelet\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914452 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c561b3ab-660e-41dc-bc03-69103e70e7ae-cni-binary-copy\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914478 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h749\" (UniqueName: \"kubernetes.io/projected/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-kube-api-access-6h749\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914503 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75d1d08d-4455-4a3a-ab83-db075f4101eb-host\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914528 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914532 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75d1d08d-4455-4a3a-ab83-db075f4101eb-serviceca\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914576 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k888b\" (UniqueName: \"kubernetes.io/projected/ccb2702a-5877-47da-8034-dc390fc78f2a-kube-api-access-k888b\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.914659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914603 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-cnibin\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914626 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-conf-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914649 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhrq\" (UniqueName: \"kubernetes.io/projected/c561b3ab-660e-41dc-bc03-69103e70e7ae-kube-api-access-zlhrq\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914674 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914700 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-systemd-units\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b41acff3-0ece-4328-843a-2bc8edcf41e7-tmp-dir\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914741 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-systemd\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914800 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-registration-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914826 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-hostroot\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914852 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-etc-kubernetes\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914875 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-tuned\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914897 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-device-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-sys-fs\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914969 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-var-lib-kubelet\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-env-overrides\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.914995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-etc-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-socket-dir-parent\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.915481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915024 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-daemon-config\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-var-lib-kubelet\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915148 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-conf-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-hostroot\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-kubernetes\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-etc-kubernetes\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-etc-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-netns\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-cnibin\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-systemd\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b41acff3-0ece-4328-843a-2bc8edcf41e7-hosts-file\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915296 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8694db8a-a823-46f9-9b48-40607fd63f11-konnectivity-ca\") pod \"konnectivity-agent-2s5fv\" (UID: \"8694db8a-a823-46f9-9b48-40607fd63f11\") " pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75d1d08d-4455-4a3a-ab83-db075f4101eb-host\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-sys-fs\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-registration-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915425 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.916263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-device-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-systemd-units\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-systemd\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915459 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915479 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-system-cni-dir\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915522 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-system-cni-dir\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-daemon-config\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.915995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08f2bdf5-941c-4cd5-981d-9bab5f883783-iptables-alerter-script\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916029 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-ovnkube-config\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916061 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysconfig\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysconfig\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916174 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysctl-conf\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916206 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-lib-modules\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-run-netns\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916257 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-ovn\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916290 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccb2702a-5877-47da-8034-dc390fc78f2a-ovn-node-metrics-cert\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-run-ovn\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysctl-conf\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-run-netns\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-lib-modules\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-cni-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916480 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-cni-multus\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916505 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916528 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-modprobe-d\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-multus-cni-dir\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916559 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08f2bdf5-941c-4cd5-981d-9bab5f883783-iptables-alerter-script\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916570 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-etc-selinux\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916556 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-cni-multus\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-ovnkube-config\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916605 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pf9rf\" (UniqueName: \"kubernetes.io/projected/08f2bdf5-941c-4cd5-981d-9bab5f883783-kube-api-access-pf9rf\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916639 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-var-lib-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-modprobe-d\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.916681 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-node-log\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-var-lib-openvswitch\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.917659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916715 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-socket-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.918298 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.916734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-etc-selinux\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.918298 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.917402 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-node-log\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.918298 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.917803 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rh2\" (UniqueName: \"kubernetes.io/projected/9f3ac370-b9ff-4616-8d6c-bed30d173359-kube-api-access-j2rh2\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.918298 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.918104 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.41803408 +0000 UTC m=+3.092169692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:02.918456 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.918374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-socket-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.918524 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.918499 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-multus-certs\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.918593 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.918575 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-slash\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.919071 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-tuned\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.919170 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919099 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccb2702a-5877-47da-8034-dc390fc78f2a-ovn-node-metrics-cert\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919434 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919480 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919506 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919555 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919589 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c13f4aed-1d67-4672-8f6e-047dbd11d42c-tmp\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919620 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8694db8a-a823-46f9-9b48-40607fd63f11-agent-certs\") pod \"konnectivity-agent-2s5fv\" (UID: \"8694db8a-a823-46f9-9b48-40607fd63f11\") " pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919650 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08f2bdf5-941c-4cd5-981d-9bab5f883783-host-slash\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919674 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-cni-bin\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919702 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-run\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919732 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-cni-netd\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919761 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-os-release\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919790 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cnibin\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919815 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysctl-d\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919844 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-host\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919875 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-cni-bin\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919938 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-kubelet\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.919964 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmw9n\" (UniqueName: \"kubernetes.io/projected/c13f4aed-1d67-4672-8f6e-047dbd11d42c-kube-api-access-lmw9n\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.920001 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-ovnkube-script-lib\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.920504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccb2702a-5877-47da-8034-dc390fc78f2a-ovnkube-script-lib\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.920596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-run-multus-certs\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.920650 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-slash\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.920726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.920779 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f3ac370-b9ff-4616-8d6c-bed30d173359-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-os-release\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08f2bdf5-941c-4cd5-981d-9bab5f883783-host-slash\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-cni-bin\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-run\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921155 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-etc-sysctl-d\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-cni-netd\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-cni-bin\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921157 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c561b3ab-660e-41dc-bc03-69103e70e7ae-host-var-lib-kubelet\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c13f4aed-1d67-4672-8f6e-047dbd11d42c-host\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccb2702a-5877-47da-8034-dc390fc78f2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.921910 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-cnibin\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.922841 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.921648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.923587 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.923524 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c13f4aed-1d67-4672-8f6e-047dbd11d42c-tmp\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:02.923853 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.923831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8694db8a-a823-46f9-9b48-40607fd63f11-agent-certs\") pod \"konnectivity-agent-2s5fv\" (UID: \"8694db8a-a823-46f9-9b48-40607fd63f11\") " pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:02.926216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.926196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsbzj\" (UniqueName: \"kubernetes.io/projected/f00a9ddf-54b4-4627-9009-1cdd4e57125d-kube-api-access-bsbzj\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:02.929206 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.929168 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:02.929618 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.929602 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:02.929729 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.929717 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:02.929892 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:02.929878 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.429858117 +0000 UTC m=+3.103993729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:02.930009 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.929983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zcnn\" (UniqueName: \"kubernetes.io/projected/b41acff3-0ece-4328-843a-2bc8edcf41e7-kube-api-access-2zcnn\") pod \"node-resolver-2ppnf\" (UID: \"b41acff3-0ece-4328-843a-2bc8edcf41e7\") " pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:02.930471 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.930423 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5dm\" (UniqueName: \"kubernetes.io/projected/75d1d08d-4455-4a3a-ab83-db075f4101eb-kube-api-access-4g5dm\") pod \"node-ca-w9kwh\" (UID: \"75d1d08d-4455-4a3a-ab83-db075f4101eb\") " pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:02.931474 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.931449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rh2\" (UniqueName: \"kubernetes.io/projected/9f3ac370-b9ff-4616-8d6c-bed30d173359-kube-api-access-j2rh2\") pod \"aws-ebs-csi-driver-node-p98ps\" (UID: \"9f3ac370-b9ff-4616-8d6c-bed30d173359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:02.931903 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.931864 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhrq\" (UniqueName: \"kubernetes.io/projected/c561b3ab-660e-41dc-bc03-69103e70e7ae-kube-api-access-zlhrq\") pod \"multus-n27xn\" (UID: \"c561b3ab-660e-41dc-bc03-69103e70e7ae\") " pod="openshift-multus/multus-n27xn" May 28 18:26:02.932146 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.932123 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf9rf\" (UniqueName: \"kubernetes.io/projected/08f2bdf5-941c-4cd5-981d-9bab5f883783-kube-api-access-pf9rf\") pod \"iptables-alerter-s9gsn\" (UID: \"08f2bdf5-941c-4cd5-981d-9bab5f883783\") " pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:02.932586 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.932528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h749\" (UniqueName: \"kubernetes.io/projected/48ac17ca-e9c6-47bc-badb-f8f1ace37c8e-kube-api-access-6h749\") pod \"multus-additional-cni-plugins-mhwxh\" (UID: \"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e\") " pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:02.933721 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.933693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k888b\" (UniqueName: \"kubernetes.io/projected/ccb2702a-5877-47da-8034-dc390fc78f2a-kube-api-access-k888b\") pod \"ovnkube-node-fnrhm\" (UID: \"ccb2702a-5877-47da-8034-dc390fc78f2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:02.933830 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:02.933811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmw9n\" (UniqueName: \"kubernetes.io/projected/c13f4aed-1d67-4672-8f6e-047dbd11d42c-kube-api-access-lmw9n\") pod \"tuned-z2m5p\" (UID: \"c13f4aed-1d67-4672-8f6e-047dbd11d42c\") " pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:03.100770 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.100690 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w9kwh" May 28 18:26:03.108570 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.108547 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s9gsn" May 28 18:26:03.117249 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.117229 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:03.122306 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.122283 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" May 28 18:26:03.128830 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.128807 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2ppnf" May 28 18:26:03.135452 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.135433 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" May 28 18:26:03.142041 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.142025 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n27xn" May 28 18:26:03.148493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.148478 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" May 28 18:26:03.154000 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.153983 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:03.422583 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.422505 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:03.422698 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.422620 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:03.422698 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.422671 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.422657102 +0000 UTC m=+4.096792695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:03.450276 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.450247 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ac17ca_e9c6_47bc_badb_f8f1ace37c8e.slice/crio-25fa6de9d1ddfae58b01cdb1895dbd7ef69e1dd4d61d3dc756e60f0cba0c15cc WatchSource:0}: Error finding container 25fa6de9d1ddfae58b01cdb1895dbd7ef69e1dd4d61d3dc756e60f0cba0c15cc: Status 404 returned error can't find the container with id 25fa6de9d1ddfae58b01cdb1895dbd7ef69e1dd4d61d3dc756e60f0cba0c15cc May 28 18:26:03.451616 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.451529 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb2702a_5877_47da_8034_dc390fc78f2a.slice/crio-6f17129eb4b2183d9e01f5a18220c096b6e414bf928ef97bbaa00cd7606f985b WatchSource:0}: Error finding container 6f17129eb4b2183d9e01f5a18220c096b6e414bf928ef97bbaa00cd7606f985b: Status 404 returned error can't find the container with id 6f17129eb4b2183d9e01f5a18220c096b6e414bf928ef97bbaa00cd7606f985b May 28 18:26:03.452442 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.452416 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f2bdf5_941c_4cd5_981d_9bab5f883783.slice/crio-525ee30d2dc2e6780477b4c675ef3337b0203d924bbe21fb91898d978c13b073 WatchSource:0}: Error finding container 525ee30d2dc2e6780477b4c675ef3337b0203d924bbe21fb91898d978c13b073: Status 404 returned error can't find the container with id 525ee30d2dc2e6780477b4c675ef3337b0203d924bbe21fb91898d978c13b073 May 28 18:26:03.454917 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.454893 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc561b3ab_660e_41dc_bc03_69103e70e7ae.slice/crio-d49c490977046e732c6d0279a18cd4b2791a965167f5eae098d4a05485883d4f WatchSource:0}: Error finding container d49c490977046e732c6d0279a18cd4b2791a965167f5eae098d4a05485883d4f: Status 404 returned error can't find the container with id d49c490977046e732c6d0279a18cd4b2791a965167f5eae098d4a05485883d4f May 28 18:26:03.455838 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.455807 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d1d08d_4455_4a3a_ab83_db075f4101eb.slice/crio-7cd35248eb06b5e932b733029bea6bcdafb0fc87afed169b9dd9babb083ce830 WatchSource:0}: Error finding container 7cd35248eb06b5e932b733029bea6bcdafb0fc87afed169b9dd9babb083ce830: Status 404 returned error can't find the container with id 7cd35248eb06b5e932b733029bea6bcdafb0fc87afed169b9dd9babb083ce830 May 28 18:26:03.456634 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.456593 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13f4aed_1d67_4672_8f6e_047dbd11d42c.slice/crio-8b110039c1f2ec9373f85a15102584e97febe5bdd68a83dfaa2cdff1eeeebf7a WatchSource:0}: Error finding container 8b110039c1f2ec9373f85a15102584e97febe5bdd68a83dfaa2cdff1eeeebf7a: Status 404 returned error can't find the container with id 8b110039c1f2ec9373f85a15102584e97febe5bdd68a83dfaa2cdff1eeeebf7a May 28 18:26:03.457838 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.457798 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8694db8a_a823_46f9_9b48_40607fd63f11.slice/crio-d6dd75556fc759e7be94802ec78d692a3eb6531bac79b998c5ef98f97df61eeb WatchSource:0}: Error finding container d6dd75556fc759e7be94802ec78d692a3eb6531bac79b998c5ef98f97df61eeb: Status 404 returned error can't find the container with id d6dd75556fc759e7be94802ec78d692a3eb6531bac79b998c5ef98f97df61eeb May 28 18:26:03.458198 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:03.458171 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3ac370_b9ff_4616_8d6c_bed30d173359.slice/crio-e20bec38e67f675b819a2ff2805ebefb81190c6abb3e50439a27dc530845b9a9 WatchSource:0}: Error finding container e20bec38e67f675b819a2ff2805ebefb81190c6abb3e50439a27dc530845b9a9: Status 404 returned error can't find the container with id e20bec38e67f675b819a2ff2805ebefb81190c6abb3e50439a27dc530845b9a9 May 28 18:26:03.523396 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.523234 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:03.523507 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.523354 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:03.523507 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.523472 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:03.523507 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.523488 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:03.523677 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.523559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.523526582 +0000 UTC m=+4.197662192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:03.849626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.849584 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:01 +0000 UTC" deadline="2028-01-26 03:19:27.143102128 +0000 UTC" May 28 18:26:03.849626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.849620 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14576h53m23.293484507s" May 28 18:26:03.929578 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.929009 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:03.929578 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:03.929140 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:03.940969 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.940896 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"6f17129eb4b2183d9e01f5a18220c096b6e414bf928ef97bbaa00cd7606f985b"} May 28 18:26:03.945958 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.945921 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerStarted","Data":"25fa6de9d1ddfae58b01cdb1895dbd7ef69e1dd4d61d3dc756e60f0cba0c15cc"} May 28 18:26:03.951055 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.950915 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" event={"ID":"9f3ac370-b9ff-4616-8d6c-bed30d173359","Type":"ContainerStarted","Data":"e20bec38e67f675b819a2ff2805ebefb81190c6abb3e50439a27dc530845b9a9"} May 28 18:26:03.954884 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.954847 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" event={"ID":"c13f4aed-1d67-4672-8f6e-047dbd11d42c","Type":"ContainerStarted","Data":"8b110039c1f2ec9373f85a15102584e97febe5bdd68a83dfaa2cdff1eeeebf7a"} May 28 18:26:03.959395 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.959347 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w9kwh" event={"ID":"75d1d08d-4455-4a3a-ab83-db075f4101eb","Type":"ContainerStarted","Data":"7cd35248eb06b5e932b733029bea6bcdafb0fc87afed169b9dd9babb083ce830"} May 28 18:26:03.961353 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.960968 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n27xn" event={"ID":"c561b3ab-660e-41dc-bc03-69103e70e7ae","Type":"ContainerStarted","Data":"d49c490977046e732c6d0279a18cd4b2791a965167f5eae098d4a05485883d4f"} May 28 18:26:03.964135 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.963328 2559 generic.go:358] "Generic (PLEG): container finished" podID="ff221295619ed8276ba0a0150a60f476" containerID="e18af338572b50906bac17933343c783aa3da8ae3f8bcf58c7019fa631d3a23c" exitCode=0 May 28 18:26:03.964135 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.963400 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" event={"ID":"ff221295619ed8276ba0a0150a60f476","Type":"ContainerDied","Data":"e18af338572b50906bac17933343c783aa3da8ae3f8bcf58c7019fa631d3a23c"} May 28 18:26:03.969951 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.969919 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" event={"ID":"273fe7d67b284666b129c476e57124bd","Type":"ContainerStarted","Data":"9ff3e37d11f3245b4913ecc8b51e25dbf5ac14de3da9e19580d7fd5a01607c73"} May 28 18:26:03.974161 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.974126 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2s5fv" event={"ID":"8694db8a-a823-46f9-9b48-40607fd63f11","Type":"ContainerStarted","Data":"d6dd75556fc759e7be94802ec78d692a3eb6531bac79b998c5ef98f97df61eeb"} May 28 18:26:03.999272 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:03.999221 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2ppnf" event={"ID":"b41acff3-0ece-4328-843a-2bc8edcf41e7","Type":"ContainerStarted","Data":"7837f3cdef2456a50ee6558f01cd9696388e8dbe9ac566a47ce5d07f53a09def"} May 28 18:26:04.004602 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:04.004548 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s9gsn" event={"ID":"08f2bdf5-941c-4cd5-981d-9bab5f883783","Type":"ContainerStarted","Data":"525ee30d2dc2e6780477b4c675ef3337b0203d924bbe21fb91898d978c13b073"} May 28 18:26:04.431044 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:04.430958 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:04.431255 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.431116 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:04.431255 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.431190 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:06.431170898 +0000 UTC m=+6.105306497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:04.532197 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:04.532111 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:04.532388 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.532295 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:04.532388 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.532313 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:04.532388 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.532325 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:04.532580 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.532392 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:06.532365929 +0000 UTC m=+6.206501531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:04.929036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:04.929002 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:04.929468 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:04.929144 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:05.023633 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:05.023597 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" event={"ID":"ff221295619ed8276ba0a0150a60f476","Type":"ContainerStarted","Data":"1acb93cc70c34e769edff25195a216fa86329bc0bd3e7958ea7c00fbfc19f2c9"} May 28 18:26:05.038859 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:05.037761 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-205.ec2.internal" podStartSLOduration=3.037745546 podStartE2EDuration="3.037745546s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:03.996107535 +0000 UTC m=+3.670243151" watchObservedRunningTime="2026-05-28 18:26:05.037745546 +0000 UTC m=+4.711881145" May 28 18:26:05.038859 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:05.038375 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-205.ec2.internal" podStartSLOduration=3.038367271 podStartE2EDuration="3.038367271s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:05.037566585 +0000 UTC m=+4.711702201" watchObservedRunningTime="2026-05-28 18:26:05.038367271 +0000 UTC m=+4.712502890" May 28 18:26:05.929563 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:05.929519 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:05.930026 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:05.929659 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:06.447005 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:06.446942 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:06.447189 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.447109 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:06.447189 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.447175 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.447154886 +0000 UTC m=+10.121290495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:06.547772 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:06.547732 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:06.547922 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.547892 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:06.547922 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.547909 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:06.547922 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.547922 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:06.548100 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.547988 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.547961179 +0000 UTC m=+10.222096773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:06.930798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:06.930760 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:06.931360 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:06.930907 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:07.929626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:07.929594 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:07.929844 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:07.929725 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:08.929627 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:08.929492 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:08.930064 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:08.929647 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:09.765736 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.765699 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-w52xr"] May 28 18:26:09.769424 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.769400 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.769558 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:09.769483 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:09.873983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.873944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa154587-a3d4-4522-92d9-24a4569ac5a1-kubelet-config\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.874157 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.873998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa154587-a3d4-4522-92d9-24a4569ac5a1-dbus\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.874157 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.874025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.929638 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.929586 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:09.930082 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:09.929720 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.975166 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa154587-a3d4-4522-92d9-24a4569ac5a1-kubelet-config\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.975200 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa154587-a3d4-4522-92d9-24a4569ac5a1-dbus\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.975223 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.975288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa154587-a3d4-4522-92d9-24a4569ac5a1-kubelet-config\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:09.975339 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:09.975391 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret podName:fa154587-a3d4-4522-92d9-24a4569ac5a1 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.475374242 +0000 UTC m=+10.149509842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret") pod "global-pull-secret-syncer-w52xr" (UID: "fa154587-a3d4-4522-92d9-24a4569ac5a1") : object "kube-system"/"original-pull-secret" not registered May 28 18:26:09.975504 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:09.975415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa154587-a3d4-4522-92d9-24a4569ac5a1-dbus\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:10.479334 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:10.479296 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:10.479529 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:10.479377 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:10.479529 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.479432 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:10.479529 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.479485 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 18:26:10.479529 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.479505 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.479484726 +0000 UTC m=+18.153620321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:10.479737 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.479559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret podName:fa154587-a3d4-4522-92d9-24a4569ac5a1 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.479530106 +0000 UTC m=+11.153665707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret") pod "global-pull-secret-syncer-w52xr" (UID: "fa154587-a3d4-4522-92d9-24a4569ac5a1") : object "kube-system"/"original-pull-secret" not registered May 28 18:26:10.579800 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:10.579764 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:10.579973 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.579923 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:10.579973 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.579946 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:10.579973 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.579960 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:10.580150 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.580031 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.58001212 +0000 UTC m=+18.254147723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:10.932423 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:10.932393 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:10.932865 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:10.932512 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:11.487246 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:11.487205 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:11.487430 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:11.487370 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 18:26:11.487490 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:11.487441 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret podName:fa154587-a3d4-4522-92d9-24a4569ac5a1 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:13.487420452 +0000 UTC m=+13.161556045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret") pod "global-pull-secret-syncer-w52xr" (UID: "fa154587-a3d4-4522-92d9-24a4569ac5a1") : object "kube-system"/"original-pull-secret" not registered May 28 18:26:11.929424 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:11.929394 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:11.929628 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:11.929391 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:11.929628 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:11.929512 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:11.929628 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:11.929583 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:12.929221 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:12.929195 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:12.929685 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:12.929349 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:13.505116 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:13.505075 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:13.505296 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:13.505238 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 18:26:13.505722 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:13.505682 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret podName:fa154587-a3d4-4522-92d9-24a4569ac5a1 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:17.505295194 +0000 UTC m=+17.179430803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret") pod "global-pull-secret-syncer-w52xr" (UID: "fa154587-a3d4-4522-92d9-24a4569ac5a1") : object "kube-system"/"original-pull-secret" not registered May 28 18:26:13.929750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:13.929713 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:13.929750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:13.929754 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:13.930257 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:13.929833 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:13.930257 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:13.929873 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:14.929417 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:14.929382 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:14.929613 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:14.929512 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:15.929191 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:15.929157 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:15.929649 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:15.929157 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:15.929649 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:15.929339 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:15.929649 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:15.929428 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:16.928933 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:16.928899 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:16.929111 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:16.929022 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:17.535054 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:17.535019 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:17.535440 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:17.535165 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 18:26:17.535440 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:17.535220 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret podName:fa154587-a3d4-4522-92d9-24a4569ac5a1 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:25.535205555 +0000 UTC m=+25.209341156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret") pod "global-pull-secret-syncer-w52xr" (UID: "fa154587-a3d4-4522-92d9-24a4569ac5a1") : object "kube-system"/"original-pull-secret" not registered May 28 18:26:17.929466 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:17.929431 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:17.929657 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:17.929431 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:17.929657 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:17.929556 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:17.929757 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:17.929657 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:18.540891 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:18.540853 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:18.541373 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.541007 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:18.541373 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.541080 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.541061343 +0000 UTC m=+34.215196954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:18.641186 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:18.641145 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:18.641347 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.641325 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:18.641422 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.641352 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:18.641422 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.641365 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:18.641518 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.641424 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.641405479 +0000 UTC m=+34.315541073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:18.929798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:18.929761 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:18.929964 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:18.929900 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:19.929370 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:19.929334 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:19.929870 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:19.929336 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:19.929870 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:19.929470 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:19.929870 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:19.929528 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:20.929614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:20.929574 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:20.930044 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:20.929682 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:21.929967 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:21.929554 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:21.930574 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:21.929578 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:21.930574 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:21.930096 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:21.930574 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:21.930165 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:22.062761 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.062733 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2s5fv" event={"ID":"8694db8a-a823-46f9-9b48-40607fd63f11","Type":"ContainerStarted","Data":"0d091c01ff1a88e904c247a9ec77f40aa4161a951cbedeb9474823c7c6bcfbeb"} May 28 18:26:22.063956 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.063925 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2ppnf" event={"ID":"b41acff3-0ece-4328-843a-2bc8edcf41e7","Type":"ContainerStarted","Data":"2d85d1ce369d2d002032e4cbfe19b5da5c56c939150ce923454b240e3f296f25"} May 28 18:26:22.065508 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.065490 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"7d35b57b51cfa3adbc9c2e796df8913b00eb74d371b02f81685d021e23e1d0dd"} May 28 18:26:22.065508 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.065513 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"64103ef7774eb964d163f71a1837c908cbaccb035cc62140149eb038003fcbb6"} May 28 18:26:22.065638 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.065522 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"fcfd79d62d5634e3969f4dbc88319e9432776ca32b7b54b9038c65ad22d8208c"} May 28 18:26:22.066606 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.066583 2559 generic.go:358] "Generic (PLEG): container finished" podID="48ac17ca-e9c6-47bc-badb-f8f1ace37c8e" containerID="b123e68c02ea47e9f61c40ac679c59c3da30ca38a2059350358b1cb97c495768" exitCode=0 May 28 18:26:22.066678 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.066657 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerDied","Data":"b123e68c02ea47e9f61c40ac679c59c3da30ca38a2059350358b1cb97c495768"} May 28 18:26:22.068015 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.067987 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" event={"ID":"9f3ac370-b9ff-4616-8d6c-bed30d173359","Type":"ContainerStarted","Data":"40893f7ce6f7beb6279c92b0ff339bee765a5a59e2529781d55f2078f6d36d61"} May 28 18:26:22.069241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.069160 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" event={"ID":"c13f4aed-1d67-4672-8f6e-047dbd11d42c","Type":"ContainerStarted","Data":"d0e45bff9ef652a552e2bed72228f14feef5c72aadeb0ddcd37bc2e3c62bb92a"} May 28 18:26:22.070337 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.070316 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w9kwh" event={"ID":"75d1d08d-4455-4a3a-ab83-db075f4101eb","Type":"ContainerStarted","Data":"f9e7eb276dbdbaea799dd033df41c9f023c77856ecbd13673a35290036571490"} May 28 18:26:22.071516 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.071495 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n27xn" event={"ID":"c561b3ab-660e-41dc-bc03-69103e70e7ae","Type":"ContainerStarted","Data":"9b06febd45a7c75fac5b6694cd61ef05368b9c8f1ad3a877a0ecfe1cb23a83b3"} May 28 18:26:22.077515 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.077479 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2s5fv" podStartSLOduration=11.24775724 podStartE2EDuration="21.077469766s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.463152608 +0000 UTC m=+3.137288205" lastFinishedPulling="2026-05-28 18:26:13.292865139 +0000 UTC m=+12.967000731" observedRunningTime="2026-05-28 18:26:22.077154767 +0000 UTC m=+21.751290592" watchObservedRunningTime="2026-05-28 18:26:22.077469766 +0000 UTC m=+21.751605380" May 28 18:26:22.111734 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.111702 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w9kwh" podStartSLOduration=3.06576527 podStartE2EDuration="21.111691766s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.457352424 +0000 UTC m=+3.131488032" lastFinishedPulling="2026-05-28 18:26:21.503278919 +0000 UTC m=+21.177414528" observedRunningTime="2026-05-28 18:26:22.091138416 +0000 UTC m=+21.765274031" watchObservedRunningTime="2026-05-28 18:26:22.111691766 +0000 UTC m=+21.785827381" May 28 18:26:22.141090 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.141049 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2ppnf" podStartSLOduration=3.054881238 podStartE2EDuration="21.141036898s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.463700908 +0000 UTC m=+3.137836520" lastFinishedPulling="2026-05-28 18:26:21.549856572 +0000 UTC m=+21.223992180" observedRunningTime="2026-05-28 18:26:22.140831565 +0000 UTC m=+21.814967179" watchObservedRunningTime="2026-05-28 18:26:22.141036898 +0000 UTC m=+21.815172514" May 28 18:26:22.141245 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.141224 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n27xn" podStartSLOduration=3.014408295 podStartE2EDuration="21.14121972s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.457234346 +0000 UTC m=+3.131369945" lastFinishedPulling="2026-05-28 18:26:21.584045768 +0000 UTC m=+21.258181370" observedRunningTime="2026-05-28 18:26:22.127044191 +0000 UTC m=+21.801179796" watchObservedRunningTime="2026-05-28 18:26:22.14121972 +0000 UTC m=+21.815355335" May 28 18:26:22.162579 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.162525 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z2m5p" podStartSLOduration=3.069549835 podStartE2EDuration="21.16251547s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.45875396 +0000 UTC m=+3.132889556" lastFinishedPulling="2026-05-28 18:26:21.551719588 +0000 UTC m=+21.225855191" observedRunningTime="2026-05-28 18:26:22.162230869 +0000 UTC m=+21.836366483" watchObservedRunningTime="2026-05-28 18:26:22.16251547 +0000 UTC m=+21.836651086" May 28 18:26:22.869923 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.869896 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 18:26:22.881395 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.881313 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T18:26:22.869919288Z","UUID":"1c961611-6131-4a99-80df-2be3996fb8d3","Handler":null,"Name":"","Endpoint":""} May 28 18:26:22.883409 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.883388 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 18:26:22.883518 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.883418 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 18:26:22.929369 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:22.929345 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:22.929514 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:22.929432 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:23.075556 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.075482 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s9gsn" event={"ID":"08f2bdf5-941c-4cd5-981d-9bab5f883783","Type":"ContainerStarted","Data":"3828d6a2d4d1475ec07e6837d0b2808fc6c38027a14ce91cc609242ff73031ab"} May 28 18:26:23.078490 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.078462 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"a85ae8e92111123da4923f24ff0009fa5447a5f6faf608c1dbece1d897e5d3e4"} May 28 18:26:23.078648 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.078497 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"9aaffb5c1714f67ee0db616b40871531cb55d5dd9e99743dbafa49e96ff4755e"} May 28 18:26:23.078648 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.078511 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"babf33745dfa41d233f29ccc7ee6f804025c50471cb5385c86104e72fa2e54c9"} May 28 18:26:23.080582 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.080475 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" event={"ID":"9f3ac370-b9ff-4616-8d6c-bed30d173359","Type":"ContainerStarted","Data":"183e8835da00a1c2f464d9da5742cd48117c8fe4a378bd11ac6da887010808d1"} May 28 18:26:23.091558 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.091467 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s9gsn" podStartSLOduration=3.9957197730000003 podStartE2EDuration="22.09145575s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.454248281 +0000 UTC m=+3.128383877" lastFinishedPulling="2026-05-28 18:26:21.549984251 +0000 UTC m=+21.224119854" observedRunningTime="2026-05-28 18:26:23.09120742 +0000 UTC m=+22.765343036" watchObservedRunningTime="2026-05-28 18:26:23.09145575 +0000 UTC m=+22.765591364" May 28 18:26:23.929761 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.929697 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:23.929934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:23.929710 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:23.929934 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:23.929805 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:23.929934 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:23.929884 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:24.932131 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:24.931968 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:24.932507 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:24.932204 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:25.086981 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.086951 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"40f2070ea2df730bc443f708264cb07400e3a673e253c2bf4aefde11b81d673a"} May 28 18:26:25.088623 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.088595 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" event={"ID":"9f3ac370-b9ff-4616-8d6c-bed30d173359","Type":"ContainerStarted","Data":"005b81f043bdf1612efdc3496951f55604218d2b7b9a8c246f32e56017244869"} May 28 18:26:25.107332 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.107291 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p98ps" podStartSLOduration=3.442044605 podStartE2EDuration="24.107278629s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.462765648 +0000 UTC m=+3.136901247" lastFinishedPulling="2026-05-28 18:26:24.127999673 +0000 UTC m=+23.802135271" observedRunningTime="2026-05-28 18:26:25.106864255 +0000 UTC m=+24.780999871" watchObservedRunningTime="2026-05-28 18:26:25.107278629 +0000 UTC m=+24.781414244" May 28 18:26:25.476244 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.476208 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:25.476840 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.476818 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:25.596436 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.596404 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:25.596628 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:25.596515 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 18:26:25.596628 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:25.596583 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret podName:fa154587-a3d4-4522-92d9-24a4569ac5a1 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:41.596569466 +0000 UTC m=+41.270705064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret") pod "global-pull-secret-syncer-w52xr" (UID: "fa154587-a3d4-4522-92d9-24a4569ac5a1") : object "kube-system"/"original-pull-secret" not registered May 28 18:26:25.929582 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.929550 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:25.929764 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:25.929550 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:25.929764 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:25.929666 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:25.929877 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:25.929753 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:26.090673 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:26.090642 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:26.091149 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:26.091048 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2s5fv" May 28 18:26:26.929144 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:26.929106 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:26.929336 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:26.929249 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:27.929743 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:27.929622 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:27.930150 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:27.929623 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:27.930150 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:27.929892 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:27.930150 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:27.929815 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:28.096751 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.096718 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" event={"ID":"ccb2702a-5877-47da-8034-dc390fc78f2a","Type":"ContainerStarted","Data":"5036462123b20e413eecf242a119c90239db4a6d0c072651dd23ce3a323454f2"} May 28 18:26:28.097049 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.097030 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:28.098428 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.098403 2559 generic.go:358] "Generic (PLEG): container finished" podID="48ac17ca-e9c6-47bc-badb-f8f1ace37c8e" containerID="8b688149b21e59a9a8ccc8a47d7736307088fd6b93bcef3e5fcd660aa2213fea" exitCode=0 May 28 18:26:28.098522 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.098451 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerDied","Data":"8b688149b21e59a9a8ccc8a47d7736307088fd6b93bcef3e5fcd660aa2213fea"} May 28 18:26:28.112301 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.112282 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:28.127378 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.127331 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" podStartSLOduration=8.863048575 podStartE2EDuration="27.12731761s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.454002573 +0000 UTC m=+3.128138165" lastFinishedPulling="2026-05-28 18:26:21.718271606 +0000 UTC m=+21.392407200" observedRunningTime="2026-05-28 18:26:28.12680234 +0000 UTC m=+27.800937955" watchObservedRunningTime="2026-05-28 18:26:28.12731761 +0000 UTC m=+27.801453224" May 28 18:26:28.932796 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:28.932764 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:28.933301 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:28.932870 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:29.100581 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.100550 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:29.100581 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.100589 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:29.114371 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.114348 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:26:29.620712 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.620638 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jqmtt"] May 28 18:26:29.620876 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.620764 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:29.620942 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:29.620889 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:29.624125 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.624102 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zqnxr"] May 28 18:26:29.624259 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.624194 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:29.624327 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:29.624303 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:29.624726 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.624708 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w52xr"] May 28 18:26:29.624821 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:29.624806 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:29.624919 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:29.624902 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:30.103714 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:30.103684 2559 generic.go:358] "Generic (PLEG): container finished" podID="48ac17ca-e9c6-47bc-badb-f8f1ace37c8e" containerID="050316edf64d43aa40dbc55be916eb48e1021ea68a2ecdda781f711da1ce1554" exitCode=0 May 28 18:26:30.104127 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:30.103774 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerDied","Data":"050316edf64d43aa40dbc55be916eb48e1021ea68a2ecdda781f711da1ce1554"} May 28 18:26:30.930289 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:30.930148 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:30.930390 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:30.930359 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:31.107889 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:31.107827 2559 generic.go:358] "Generic (PLEG): container finished" podID="48ac17ca-e9c6-47bc-badb-f8f1ace37c8e" containerID="e2330216e1af60ba473922341eb5d3461ac2e1770a35233fc9752377e6d4ac23" exitCode=0 May 28 18:26:31.108282 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:31.107906 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerDied","Data":"e2330216e1af60ba473922341eb5d3461ac2e1770a35233fc9752377e6d4ac23"} May 28 18:26:31.929608 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:31.929572 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:31.929767 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:31.929573 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:31.929767 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:31.929702 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:31.929869 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:31.929801 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:32.932866 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:32.932835 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:32.933340 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:32.932961 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:26:33.929366 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:33.929335 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:33.929559 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:33.929336 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:33.929559 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:33.929448 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w52xr" podUID="fa154587-a3d4-4522-92d9-24a4569ac5a1" May 28 18:26:33.929559 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:33.929515 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqmtt" podUID="0e9a1853-98b6-4ab7-ae72-c8ce303d84d0" May 28 18:26:34.174399 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.174370 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-205.ec2.internal" event="NodeReady" May 28 18:26:34.174785 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.174491 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 18:26:34.222700 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.222630 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nqcr8"] May 28 18:26:34.245559 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.245499 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7w95w"] May 28 18:26:34.245683 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.245668 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.248766 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.248730 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 18:26:34.248984 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.248962 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 18:26:34.249973 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.249265 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpf94\"" May 28 18:26:34.271657 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.271634 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqcr8"] May 28 18:26:34.271769 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.271663 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7w95w"] May 28 18:26:34.271769 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.271759 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.274801 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.274777 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 18:26:34.274915 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.274814 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 18:26:34.274915 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.274877 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7dfk\"" May 28 18:26:34.275027 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.274977 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 18:26:34.367874 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.367831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f614b2f-6dea-4d48-849e-da6175b5cd2f-tmp-dir\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.368030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.367900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.368030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.367930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwrk\" (UniqueName: \"kubernetes.io/projected/6f614b2f-6dea-4d48-849e-da6175b5cd2f-kube-api-access-dlwrk\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.368030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.367957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brljd\" (UniqueName: \"kubernetes.io/projected/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-kube-api-access-brljd\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.368030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.368026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.368188 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.368058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f614b2f-6dea-4d48-849e-da6175b5cd2f-config-volume\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.468620 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.468590 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwrk\" (UniqueName: \"kubernetes.io/projected/6f614b2f-6dea-4d48-849e-da6175b5cd2f-kube-api-access-dlwrk\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.468762 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.468623 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brljd\" (UniqueName: \"kubernetes.io/projected/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-kube-api-access-brljd\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.468762 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.468647 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.468762 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.468680 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f614b2f-6dea-4d48-849e-da6175b5cd2f-config-volume\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.468762 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.468718 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f614b2f-6dea-4d48-849e-da6175b5cd2f-tmp-dir\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.468762 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.468752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.469002 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.468818 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:34.469002 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.468840 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:34.469002 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.468883 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.968864883 +0000 UTC m=+34.643000476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:26:34.469002 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.468904 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.968892992 +0000 UTC m=+34.643028592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:26:34.469179 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.469161 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f614b2f-6dea-4d48-849e-da6175b5cd2f-tmp-dir\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.469262 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.469245 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f614b2f-6dea-4d48-849e-da6175b5cd2f-config-volume\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.479748 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.479701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwrk\" (UniqueName: \"kubernetes.io/projected/6f614b2f-6dea-4d48-849e-da6175b5cd2f-kube-api-access-dlwrk\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.479841 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.479792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brljd\" (UniqueName: \"kubernetes.io/projected/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-kube-api-access-brljd\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.569268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.569229 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:34.569428 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.569384 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:34.569488 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.569458 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.56944321 +0000 UTC m=+66.243578804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 18:26:34.670723 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.670678 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:34.670901 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.670835 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 18:26:34.670901 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.670852 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 18:26:34.670901 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.670864 2559 projected.go:194] Error preparing data for projected volume kube-api-access-tzqgz for pod openshift-network-diagnostics/network-check-target-jqmtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:34.671063 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.670930 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz podName:0e9a1853-98b6-4ab7-ae72-c8ce303d84d0 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.670912661 +0000 UTC m=+66.345048271 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzqgz" (UniqueName: "kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz") pod "network-check-target-jqmtt" (UID: "0e9a1853-98b6-4ab7-ae72-c8ce303d84d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 18:26:34.932776 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.932748 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:26:34.935832 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.935811 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 18:26:34.935960 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.935822 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2t4h\"" May 28 18:26:34.973776 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.973746 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:34.973891 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:34.973850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:34.973947 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.973886 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:34.973996 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.973960 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:26:35.973941029 +0000 UTC m=+35.648076644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:26:34.973996 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.973973 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:34.974103 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:34.974028 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:35.974010556 +0000 UTC m=+35.648146155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:26:35.929102 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.929061 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:26:35.929102 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.929095 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:35.932364 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.932338 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 18:26:35.932493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.932436 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 18:26:35.933450 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.933429 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 18:26:35.933584 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.933434 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rmft\"" May 28 18:26:35.983028 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.982994 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:35.983166 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:35.983059 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:35.983166 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:35.983153 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:35.983261 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:35.983222 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:37.98320232 +0000 UTC m=+37.657337927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:26:35.983261 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:35.983228 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:35.983360 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:35.983284 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:26:37.983268874 +0000 UTC m=+37.657404514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:26:37.122075 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:37.122039 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerStarted","Data":"e52b4bf8faab0961f81f890bebc31eb72a27525af48c26151fb5951b68114205"} May 28 18:26:37.997908 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:37.997875 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:37.998058 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:37.997922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:37.998058 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:37.998007 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:37.998058 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:37.998019 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:37.998156 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:37.998069 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:26:41.998055531 +0000 UTC m=+41.672191123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:26:37.998156 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:37.998082 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:41.998076416 +0000 UTC m=+41.672212009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:26:38.126033 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:38.126000 2559 generic.go:358] "Generic (PLEG): container finished" podID="48ac17ca-e9c6-47bc-badb-f8f1ace37c8e" containerID="e52b4bf8faab0961f81f890bebc31eb72a27525af48c26151fb5951b68114205" exitCode=0 May 28 18:26:38.126381 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:38.126050 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerDied","Data":"e52b4bf8faab0961f81f890bebc31eb72a27525af48c26151fb5951b68114205"} May 28 18:26:39.129926 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:39.129879 2559 generic.go:358] "Generic (PLEG): container finished" podID="48ac17ca-e9c6-47bc-badb-f8f1ace37c8e" containerID="0b9c59caa7d87a6049b73bfc292567f8e08ebf9b7b5cd906209db80d61b37a31" exitCode=0 May 28 18:26:39.130261 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:39.129934 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerDied","Data":"0b9c59caa7d87a6049b73bfc292567f8e08ebf9b7b5cd906209db80d61b37a31"} May 28 18:26:40.133948 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:40.133912 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" event={"ID":"48ac17ca-e9c6-47bc-badb-f8f1ace37c8e","Type":"ContainerStarted","Data":"811eb80906fc2d03c93f5d1a97966bec7488117161155797ec32c07803348a23"} May 28 18:26:40.157007 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:40.156958 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mhwxh" podStartSLOduration=5.691595452 podStartE2EDuration="39.156945147s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.451852723 +0000 UTC m=+3.125988316" lastFinishedPulling="2026-05-28 18:26:36.917202418 +0000 UTC m=+36.591338011" observedRunningTime="2026-05-28 18:26:40.155407937 +0000 UTC m=+39.829543551" watchObservedRunningTime="2026-05-28 18:26:40.156945147 +0000 UTC m=+39.831080762" May 28 18:26:41.623071 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:41.623031 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:41.625790 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:41.625756 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa154587-a3d4-4522-92d9-24a4569ac5a1-original-pull-secret\") pod \"global-pull-secret-syncer-w52xr\" (UID: \"fa154587-a3d4-4522-92d9-24a4569ac5a1\") " pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:41.645888 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:41.645860 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w52xr" May 28 18:26:41.766526 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:41.766499 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w52xr"] May 28 18:26:41.770401 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:26:41.770374 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa154587_a3d4_4522_92d9_24a4569ac5a1.slice/crio-adc5205b9fdff8ef50239505a5dc6372422d068c723698763ee34f1a339f0072 WatchSource:0}: Error finding container adc5205b9fdff8ef50239505a5dc6372422d068c723698763ee34f1a339f0072: Status 404 returned error can't find the container with id adc5205b9fdff8ef50239505a5dc6372422d068c723698763ee34f1a339f0072 May 28 18:26:42.025887 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:42.025859 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:42.026053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:42.025899 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:42.026053 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:42.025998 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:42.026053 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:42.026018 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:42.026053 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:42.026049 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:26:50.026033803 +0000 UTC m=+49.700169396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:26:42.026235 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:42.026080 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:50.026063025 +0000 UTC m=+49.700198638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:26:42.138555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:42.138506 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w52xr" event={"ID":"fa154587-a3d4-4522-92d9-24a4569ac5a1","Type":"ContainerStarted","Data":"adc5205b9fdff8ef50239505a5dc6372422d068c723698763ee34f1a339f0072"} May 28 18:26:46.146777 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:46.146743 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w52xr" event={"ID":"fa154587-a3d4-4522-92d9-24a4569ac5a1","Type":"ContainerStarted","Data":"60ce5da73a5b618d146bc2d0c475753fc8e75d33812430dfe5fda4780e88c285"} May 28 18:26:46.161355 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:46.161316 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w52xr" podStartSLOduration=33.359859568 podStartE2EDuration="37.161303774s" podCreationTimestamp="2026-05-28 18:26:09 +0000 UTC" firstStartedPulling="2026-05-28 18:26:41.77275918 +0000 UTC m=+41.446894776" lastFinishedPulling="2026-05-28 18:26:45.574203386 +0000 UTC m=+45.248338982" observedRunningTime="2026-05-28 18:26:46.160841394 +0000 UTC m=+45.834977034" watchObservedRunningTime="2026-05-28 18:26:46.161303774 +0000 UTC m=+45.835439388" May 28 18:26:50.084597 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:50.084562 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:26:50.085062 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:26:50.084605 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:26:50.085062 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:50.084701 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:26:50.085062 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:50.084763 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.08474798 +0000 UTC m=+65.758883573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:26:50.085062 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:50.084704 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:26:50.085062 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:26:50.084828 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.084816717 +0000 UTC m=+65.758952310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:27:01.124659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:01.124632 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrhm" May 28 18:27:06.089379 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.089338 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:27:06.089808 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.089414 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:27:06.089808 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:06.089489 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:27:06.089808 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:06.089576 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:27:38.089560236 +0000 UTC m=+97.763695829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:27:06.089808 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:06.089494 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:27:06.089808 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:06.089630 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:38.089618399 +0000 UTC m=+97.763753993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:27:06.593794 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.593759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:27:06.596326 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.596309 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 18:27:06.604496 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:06.604470 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 18:27:06.604562 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:06.604532 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:28:10.604516252 +0000 UTC m=+130.278651844 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : secret "metrics-daemon-secret" not found May 28 18:27:06.694786 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.694752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:27:06.697653 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.697636 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 18:27:06.707666 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.707652 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 18:27:06.718889 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.718872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqgz\" (UniqueName: \"kubernetes.io/projected/0e9a1853-98b6-4ab7-ae72-c8ce303d84d0-kube-api-access-tzqgz\") pod \"network-check-target-jqmtt\" (UID: \"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0\") " pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:27:06.843001 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.842975 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rmft\"" May 28 18:27:06.851142 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.851091 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:27:06.988966 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:06.988939 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jqmtt"] May 28 18:27:06.992780 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:27:06.992756 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9a1853_98b6_4ab7_ae72_c8ce303d84d0.slice/crio-e94b85fa9e3b6e49081e0ff955c0aff7fe20ce859662d594d00c4d422bbb9dc1 WatchSource:0}: Error finding container e94b85fa9e3b6e49081e0ff955c0aff7fe20ce859662d594d00c4d422bbb9dc1: Status 404 returned error can't find the container with id e94b85fa9e3b6e49081e0ff955c0aff7fe20ce859662d594d00c4d422bbb9dc1 May 28 18:27:07.188454 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:07.188414 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jqmtt" event={"ID":"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0","Type":"ContainerStarted","Data":"e94b85fa9e3b6e49081e0ff955c0aff7fe20ce859662d594d00c4d422bbb9dc1"} May 28 18:27:11.196879 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:11.196835 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jqmtt" event={"ID":"0e9a1853-98b6-4ab7-ae72-c8ce303d84d0","Type":"ContainerStarted","Data":"61b5b09f1b830f0866b2c7e172cae762c42a7a765b2f573d677db5b61038ac49"} May 28 18:27:11.197274 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:11.197090 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:27:11.212633 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:11.212589 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jqmtt" podStartSLOduration=67.932050167 podStartE2EDuration="1m11.21252315s" podCreationTimestamp="2026-05-28 18:26:00 +0000 UTC" firstStartedPulling="2026-05-28 18:27:06.994984533 +0000 UTC m=+66.669120126" lastFinishedPulling="2026-05-28 18:27:10.275457501 +0000 UTC m=+69.949593109" observedRunningTime="2026-05-28 18:27:11.212420205 +0000 UTC m=+70.886555822" watchObservedRunningTime="2026-05-28 18:27:11.21252315 +0000 UTC m=+70.886658765" May 28 18:27:38.107369 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:38.107261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:27:38.107369 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:38.107303 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:27:38.107880 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:38.107403 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 18:27:38.107880 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:38.107424 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 18:27:38.107880 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:38.107466 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert podName:41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c nodeName:}" failed. No retries permitted until 2026-05-28 18:28:42.107450034 +0000 UTC m=+161.781585626 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert") pod "ingress-canary-7w95w" (UID: "41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c") : secret "canary-serving-cert" not found May 28 18:27:38.107880 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:38.107494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls podName:6f614b2f-6dea-4d48-849e-da6175b5cd2f nodeName:}" failed. No retries permitted until 2026-05-28 18:28:42.107475635 +0000 UTC m=+161.781611247 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls") pod "dns-default-nqcr8" (UID: "6f614b2f-6dea-4d48-849e-da6175b5cd2f") : secret "dns-default-metrics-tls" not found May 28 18:27:42.201062 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:42.201033 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jqmtt" May 28 18:27:56.800220 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.800189 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m"] May 28 18:27:56.801953 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.801937 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" May 28 18:27:56.805619 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.805593 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 28 18:27:56.806395 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.806377 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ccp2c\"" May 28 18:27:56.807169 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.807152 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 28 18:27:56.812011 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.811984 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m"] May 28 18:27:56.911284 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.911255 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g"] May 28 18:27:56.913203 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.913186 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8"] May 28 18:27:56.913319 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.913303 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:56.915076 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.915056 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" May 28 18:27:56.918691 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.918667 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 28 18:27:56.918789 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.918730 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 18:27:56.919695 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.919674 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-89bfcb4fb-nzlzm"] May 28 18:27:56.924024 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.921814 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 18:27:56.924024 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.922051 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nnf7m\"" May 28 18:27:56.924024 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.922525 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6qbg7\"" May 28 18:27:56.924024 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.923439 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 28 18:27:56.924669 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.924380 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:56.925652 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.925625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt5w2\" (UniqueName: \"kubernetes.io/projected/31ed9c7b-6d56-4a1b-a62a-38b6971fddb7-kube-api-access-nt5w2\") pod \"volume-data-source-validator-5cf8c89d64-stf2m\" (UID: \"31ed9c7b-6d56-4a1b-a62a-38b6971fddb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" May 28 18:27:56.927074 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.927058 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 18:27:56.927492 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.927454 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 18:27:56.927764 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.927488 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 18:27:56.929201 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.927846 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fkxwd\"" May 28 18:27:56.929201 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.928065 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 18:27:56.929201 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.928206 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 18:27:56.929201 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.928671 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 18:27:56.932493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.932477 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g"] May 28 18:27:56.932578 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.932503 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8"] May 28 18:27:56.938428 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:56.938408 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-89bfcb4fb-nzlzm"] May 28 18:27:57.015032 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.014999 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-6fzbj"] May 28 18:27:57.016993 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.016971 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.019612 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.019591 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 28 18:27:57.019739 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.019664 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 28 18:27:57.019905 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.019864 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 28 18:27:57.019983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.019936 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 28 18:27:57.020045 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.020012 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6zcdn\"" May 28 18:27:57.025996 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.025975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/90f5d168-859e-4381-afd8-5705fef932e2-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.026121 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026027 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nt5w2\" (UniqueName: \"kubernetes.io/projected/31ed9c7b-6d56-4a1b-a62a-38b6971fddb7-kube-api-access-nt5w2\") pod \"volume-data-source-validator-5cf8c89d64-stf2m\" (UID: \"31ed9c7b-6d56-4a1b-a62a-38b6971fddb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" May 28 18:27:57.026121 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxzlw\" (UniqueName: \"kubernetes.io/projected/f853c1a0-1a89-4cf7-8859-d9a22d3cbad2-kube-api-access-cxzlw\") pod \"network-check-source-7f44b6dd87-8gns8\" (UID: \"f853c1a0-1a89-4cf7-8859-d9a22d3cbad2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" May 28 18:27:57.026257 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.026257 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxs8\" (UniqueName: \"kubernetes.io/projected/90f5d168-859e-4381-afd8-5705fef932e2-kube-api-access-zjxs8\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.026257 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026151 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 28 18:27:57.026257 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzj64\" (UniqueName: \"kubernetes.io/projected/2ceb4be7-01b2-4f34-babf-c42b2a24931a-kube-api-access-tzj64\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.026257 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-stats-auth\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.026457 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.026457 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.026457 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.026371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-default-certificate\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.033228 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.033208 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-6fzbj"] May 28 18:27:57.051098 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.051046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt5w2\" (UniqueName: \"kubernetes.io/projected/31ed9c7b-6d56-4a1b-a62a-38b6971fddb7-kube-api-access-nt5w2\") pod \"volume-data-source-validator-5cf8c89d64-stf2m\" (UID: \"31ed9c7b-6d56-4a1b-a62a-38b6971fddb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" May 28 18:27:57.110213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.110179 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" May 28 18:27:57.127206 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31e687ed-4778-415d-a9b1-21ae28ebb824-config\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.127327 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxzlw\" (UniqueName: \"kubernetes.io/projected/f853c1a0-1a89-4cf7-8859-d9a22d3cbad2-kube-api-access-cxzlw\") pod \"network-check-source-7f44b6dd87-8gns8\" (UID: \"f853c1a0-1a89-4cf7-8859-d9a22d3cbad2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" May 28 18:27:57.127327 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127242 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.127327 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127317 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxs8\" (UniqueName: \"kubernetes.io/projected/90f5d168-859e-4381-afd8-5705fef932e2-kube-api-access-zjxs8\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.127500 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.127333 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 18:27:57.127500 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127362 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzj64\" (UniqueName: \"kubernetes.io/projected/2ceb4be7-01b2-4f34-babf-c42b2a24931a-kube-api-access-tzj64\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.127500 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.127392 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls podName:90f5d168-859e-4381-afd8-5705fef932e2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:57.627372602 +0000 UTC m=+117.301508216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jt84g" (UID: "90f5d168-859e-4381-afd8-5705fef932e2") : secret "cluster-monitoring-operator-tls" not found May 28 18:27:57.127500 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127422 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-stats-auth\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.127500 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127453 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.127500 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127480 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q9qs\" (UniqueName: \"kubernetes.io/projected/31e687ed-4778-415d-a9b1-21ae28ebb824-kube-api-access-6q9qs\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127580 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-default-certificate\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.127624 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:27:57.627606614 +0000 UTC m=+117.301742227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : configmap references non-existent config key: service-ca.crt May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.127631 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31e687ed-4778-415d-a9b1-21ae28ebb824-serving-cert\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.127676 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:27:57.627661407 +0000 UTC m=+117.301797019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : secret "router-metrics-certs-default" not found May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127725 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/90f5d168-859e-4381-afd8-5705fef932e2-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.127807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.127751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31e687ed-4778-415d-a9b1-21ae28ebb824-trusted-ca\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.128626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.128605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/90f5d168-859e-4381-afd8-5705fef932e2-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.130378 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.130357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-stats-auth\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.130378 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.130371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-default-certificate\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.137934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.137909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxzlw\" (UniqueName: \"kubernetes.io/projected/f853c1a0-1a89-4cf7-8859-d9a22d3cbad2-kube-api-access-cxzlw\") pod \"network-check-source-7f44b6dd87-8gns8\" (UID: \"f853c1a0-1a89-4cf7-8859-d9a22d3cbad2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" May 28 18:27:57.138653 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.138634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzj64\" (UniqueName: \"kubernetes.io/projected/2ceb4be7-01b2-4f34-babf-c42b2a24931a-kube-api-access-tzj64\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.138730 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.138714 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxs8\" (UniqueName: \"kubernetes.io/projected/90f5d168-859e-4381-afd8-5705fef932e2-kube-api-access-zjxs8\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.228839 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.228810 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m"] May 28 18:27:57.228991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.228877 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31e687ed-4778-415d-a9b1-21ae28ebb824-serving-cert\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.228991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.228926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31e687ed-4778-415d-a9b1-21ae28ebb824-trusted-ca\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.228991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.228968 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31e687ed-4778-415d-a9b1-21ae28ebb824-config\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.229141 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.229053 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6q9qs\" (UniqueName: \"kubernetes.io/projected/31e687ed-4778-415d-a9b1-21ae28ebb824-kube-api-access-6q9qs\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.229751 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.229727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31e687ed-4778-415d-a9b1-21ae28ebb824-config\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.229978 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.229921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31e687ed-4778-415d-a9b1-21ae28ebb824-trusted-ca\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.231060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.231045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31e687ed-4778-415d-a9b1-21ae28ebb824-serving-cert\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.231118 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.231107 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" May 28 18:27:57.231982 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:27:57.231962 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ed9c7b_6d56_4a1b_a62a_38b6971fddb7.slice/crio-9444d1fc15862adcb457aaddffc57a50235d426375106536ec693e28cf1dd7cf WatchSource:0}: Error finding container 9444d1fc15862adcb457aaddffc57a50235d426375106536ec693e28cf1dd7cf: Status 404 returned error can't find the container with id 9444d1fc15862adcb457aaddffc57a50235d426375106536ec693e28cf1dd7cf May 28 18:27:57.237494 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.237479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q9qs\" (UniqueName: \"kubernetes.io/projected/31e687ed-4778-415d-a9b1-21ae28ebb824-kube-api-access-6q9qs\") pod \"console-operator-76dff48d59-6fzbj\" (UID: \"31e687ed-4778-415d-a9b1-21ae28ebb824\") " pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.285479 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.285437 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" event={"ID":"31ed9c7b-6d56-4a1b-a62a-38b6971fddb7","Type":"ContainerStarted","Data":"9444d1fc15862adcb457aaddffc57a50235d426375106536ec693e28cf1dd7cf"} May 28 18:27:57.325458 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.325400 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:27:57.343132 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.343103 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8"] May 28 18:27:57.346941 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:27:57.346915 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf853c1a0_1a89_4cf7_8859_d9a22d3cbad2.slice/crio-4cdcd92df5fdcf9d732e97ac13f62c68f74cd2c56b5d4e7d3542266048400ea3 WatchSource:0}: Error finding container 4cdcd92df5fdcf9d732e97ac13f62c68f74cd2c56b5d4e7d3542266048400ea3: Status 404 returned error can't find the container with id 4cdcd92df5fdcf9d732e97ac13f62c68f74cd2c56b5d4e7d3542266048400ea3 May 28 18:27:57.448707 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.448675 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-6fzbj"] May 28 18:27:57.452108 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:27:57.452075 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e687ed_4778_415d_a9b1_21ae28ebb824.slice/crio-36fd879736d2c9a8e20b24a8f833ac0cf9fd79b90c61f4deb13c6d23cbfa0faf WatchSource:0}: Error finding container 36fd879736d2c9a8e20b24a8f833ac0cf9fd79b90c61f4deb13c6d23cbfa0faf: Status 404 returned error can't find the container with id 36fd879736d2c9a8e20b24a8f833ac0cf9fd79b90c61f4deb13c6d23cbfa0faf May 28 18:27:57.633482 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.633418 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.633482 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.633448 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:57.633748 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.633595 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:27:58.633577763 +0000 UTC m=+118.307713374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : configmap references non-existent config key: service-ca.crt May 28 18:27:57.633748 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.633641 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 18:27:57.633748 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:57.633642 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:57.633748 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.633679 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:27:58.633667628 +0000 UTC m=+118.307803221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : secret "router-metrics-certs-default" not found May 28 18:27:57.633748 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.633741 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 18:27:57.633906 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:57.633788 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls podName:90f5d168-859e-4381-afd8-5705fef932e2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:58.63377584 +0000 UTC m=+118.307911434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jt84g" (UID: "90f5d168-859e-4381-afd8-5705fef932e2") : secret "cluster-monitoring-operator-tls" not found May 28 18:27:58.290734 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.290687 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" event={"ID":"f853c1a0-1a89-4cf7-8859-d9a22d3cbad2","Type":"ContainerStarted","Data":"60446a3e2b553766a9e1ba271023abbed5eb0653d30c84f6cea56ab6fe0843f9"} May 28 18:27:58.291217 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.290743 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" event={"ID":"f853c1a0-1a89-4cf7-8859-d9a22d3cbad2","Type":"ContainerStarted","Data":"4cdcd92df5fdcf9d732e97ac13f62c68f74cd2c56b5d4e7d3542266048400ea3"} May 28 18:27:58.293470 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.293427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" event={"ID":"31e687ed-4778-415d-a9b1-21ae28ebb824","Type":"ContainerStarted","Data":"36fd879736d2c9a8e20b24a8f833ac0cf9fd79b90c61f4deb13c6d23cbfa0faf"} May 28 18:27:58.308664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.308614 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-8gns8" podStartSLOduration=2.308596462 podStartE2EDuration="2.308596462s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:27:58.307627948 +0000 UTC m=+117.981763564" watchObservedRunningTime="2026-05-28 18:27:58.308596462 +0000 UTC m=+117.982732106" May 28 18:27:58.642918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.642815 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:27:58.642918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.642887 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:58.642918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:27:58.642916 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:27:58.643198 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:58.642958 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 18:27:58.643198 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:58.643015 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 18:27:58.643198 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:58.643033 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls podName:90f5d168-859e-4381-afd8-5705fef932e2 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:00.643012738 +0000 UTC m=+120.317148344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jt84g" (UID: "90f5d168-859e-4381-afd8-5705fef932e2") : secret "cluster-monitoring-operator-tls" not found May 28 18:27:58.643198 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:58.643050 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:00.643039745 +0000 UTC m=+120.317175338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : secret "router-metrics-certs-default" not found May 28 18:27:58.643198 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:27:58.643104 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:00.643095508 +0000 UTC m=+120.317231107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : configmap references non-existent config key: service-ca.crt May 28 18:28:00.299915 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.299873 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" event={"ID":"31ed9c7b-6d56-4a1b-a62a-38b6971fddb7","Type":"ContainerStarted","Data":"8daa886992fa54e0921d4315bd2b66fad3604f33fa8081c91825eb67875fb683"} May 28 18:28:00.301248 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.301228 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/0.log" May 28 18:28:00.301366 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.301260 2559 generic.go:358] "Generic (PLEG): container finished" podID="31e687ed-4778-415d-a9b1-21ae28ebb824" containerID="9e4d155a00959b15975c1b68acc9b539b32235ede8ab7481410eb8d0264a4c31" exitCode=255 May 28 18:28:00.301366 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.301287 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" event={"ID":"31e687ed-4778-415d-a9b1-21ae28ebb824","Type":"ContainerDied","Data":"9e4d155a00959b15975c1b68acc9b539b32235ede8ab7481410eb8d0264a4c31"} May 28 18:28:00.301491 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.301476 2559 scope.go:117] "RemoveContainer" containerID="9e4d155a00959b15975c1b68acc9b539b32235ede8ab7481410eb8d0264a4c31" May 28 18:28:00.330397 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.330358 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-stf2m" podStartSLOduration=2.333517614 podStartE2EDuration="4.330345135s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:27:57.234515074 +0000 UTC m=+116.908650680" lastFinishedPulling="2026-05-28 18:27:59.23134259 +0000 UTC m=+118.905478201" observedRunningTime="2026-05-28 18:28:00.313888842 +0000 UTC m=+119.988024457" watchObservedRunningTime="2026-05-28 18:28:00.330345135 +0000 UTC m=+120.004480820" May 28 18:28:00.661349 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.661310 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:28:00.661498 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.661357 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:00.661498 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:00.661380 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:00.661498 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:00.661460 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 18:28:00.661498 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:00.661487 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 18:28:00.661687 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:00.661501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:04.661480677 +0000 UTC m=+124.335616274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : configmap references non-existent config key: service-ca.crt May 28 18:28:00.661687 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:00.661522 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:04.661512361 +0000 UTC m=+124.335647956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : secret "router-metrics-certs-default" not found May 28 18:28:00.661687 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:00.661557 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls podName:90f5d168-859e-4381-afd8-5705fef932e2 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:04.661528772 +0000 UTC m=+124.335664368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jt84g" (UID: "90f5d168-859e-4381-afd8-5705fef932e2") : secret "cluster-monitoring-operator-tls" not found May 28 18:28:01.305506 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:01.305479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/1.log" May 28 18:28:01.305931 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:01.305839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/0.log" May 28 18:28:01.305931 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:01.305871 2559 generic.go:358] "Generic (PLEG): container finished" podID="31e687ed-4778-415d-a9b1-21ae28ebb824" containerID="e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66" exitCode=255 May 28 18:28:01.305997 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:01.305967 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" event={"ID":"31e687ed-4778-415d-a9b1-21ae28ebb824","Type":"ContainerDied","Data":"e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66"} May 28 18:28:01.306030 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:01.306016 2559 scope.go:117] "RemoveContainer" containerID="9e4d155a00959b15975c1b68acc9b539b32235ede8ab7481410eb8d0264a4c31" May 28 18:28:01.306252 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:01.306235 2559 scope.go:117] "RemoveContainer" containerID="e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66" May 28 18:28:01.306428 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:01.306411 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-6fzbj_openshift-console-operator(31e687ed-4778-415d-a9b1-21ae28ebb824)\"" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podUID="31e687ed-4778-415d-a9b1-21ae28ebb824" May 28 18:28:02.309058 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:02.309035 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/1.log" May 28 18:28:02.309499 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:02.309346 2559 scope.go:117] "RemoveContainer" containerID="e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66" May 28 18:28:02.309561 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:02.309497 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-6fzbj_openshift-console-operator(31e687ed-4778-415d-a9b1-21ae28ebb824)\"" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podUID="31e687ed-4778-415d-a9b1-21ae28ebb824" May 28 18:28:03.592251 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.592219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2ppnf_b41acff3-0ece-4328-843a-2bc8edcf41e7/dns-node-resolver/0.log" May 28 18:28:03.919478 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.919444 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9v85s"] May 28 18:28:03.922046 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.922030 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:03.925063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.925035 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 28 18:28:03.925063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.925059 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 28 18:28:03.925235 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.925077 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 28 18:28:03.925354 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.925341 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 28 18:28:03.926247 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.926229 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cms9k\"" May 28 18:28:03.935684 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.935660 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9v85s"] May 28 18:28:03.986412 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.986377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad44d80e-d142-4464-98fc-6cd208845e52-signing-cabundle\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:03.986611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.986505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad44d80e-d142-4464-98fc-6cd208845e52-signing-key\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:03.986611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:03.986599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67lb2\" (UniqueName: \"kubernetes.io/projected/ad44d80e-d142-4464-98fc-6cd208845e52-kube-api-access-67lb2\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.087282 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.087250 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad44d80e-d142-4464-98fc-6cd208845e52-signing-cabundle\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.087438 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.087332 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad44d80e-d142-4464-98fc-6cd208845e52-signing-key\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.087438 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.087362 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67lb2\" (UniqueName: \"kubernetes.io/projected/ad44d80e-d142-4464-98fc-6cd208845e52-kube-api-access-67lb2\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.087959 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.087933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad44d80e-d142-4464-98fc-6cd208845e52-signing-cabundle\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.089691 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.089665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad44d80e-d142-4464-98fc-6cd208845e52-signing-key\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.095602 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.095580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67lb2\" (UniqueName: \"kubernetes.io/projected/ad44d80e-d142-4464-98fc-6cd208845e52-kube-api-access-67lb2\") pod \"service-ca-67d667c7d-9v85s\" (UID: \"ad44d80e-d142-4464-98fc-6cd208845e52\") " pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.230112 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.230023 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9v85s" May 28 18:28:04.349057 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.349027 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9v85s"] May 28 18:28:04.352141 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:04.352113 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad44d80e_d142_4464_98fc_6cd208845e52.slice/crio-2c6c20cd327e1ac057af0e99eaba80b5a79304a1ede41b63118b282ee9755eaf WatchSource:0}: Error finding container 2c6c20cd327e1ac057af0e99eaba80b5a79304a1ede41b63118b282ee9755eaf: Status 404 returned error can't find the container with id 2c6c20cd327e1ac057af0e99eaba80b5a79304a1ede41b63118b282ee9755eaf May 28 18:28:04.691790 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.691756 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.691807 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.691835 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:04.691898 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:04.691945 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:04.691980 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:12.69196019 +0000 UTC m=+132.366095783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : configmap references non-existent config key: service-ca.crt May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:04.692013 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:12.691996096 +0000 UTC m=+132.366131689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : secret "router-metrics-certs-default" not found May 28 18:28:04.692219 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:04.692036 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls podName:90f5d168-859e-4381-afd8-5705fef932e2 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:12.692027172 +0000 UTC m=+132.366162765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jt84g" (UID: "90f5d168-859e-4381-afd8-5705fef932e2") : secret "cluster-monitoring-operator-tls" not found May 28 18:28:04.992821 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:04.992746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w9kwh_75d1d08d-4455-4a3a-ab83-db075f4101eb/node-ca/0.log" May 28 18:28:05.316923 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:05.316833 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9v85s" event={"ID":"ad44d80e-d142-4464-98fc-6cd208845e52","Type":"ContainerStarted","Data":"2c6c20cd327e1ac057af0e99eaba80b5a79304a1ede41b63118b282ee9755eaf"} May 28 18:28:06.320232 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:06.320151 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9v85s" event={"ID":"ad44d80e-d142-4464-98fc-6cd208845e52","Type":"ContainerStarted","Data":"6fbd33bfbb754343451c750d9cef834d8b1a715010d42733712a6a539869da7e"} May 28 18:28:06.336396 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:06.336353 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-9v85s" podStartSLOduration=1.763543896 podStartE2EDuration="3.336338448s" podCreationTimestamp="2026-05-28 18:28:03 +0000 UTC" firstStartedPulling="2026-05-28 18:28:04.354038598 +0000 UTC m=+124.028174194" lastFinishedPulling="2026-05-28 18:28:05.926833135 +0000 UTC m=+125.600968746" observedRunningTime="2026-05-28 18:28:06.335686731 +0000 UTC m=+126.009822352" watchObservedRunningTime="2026-05-28 18:28:06.336338448 +0000 UTC m=+126.010474063" May 28 18:28:07.325568 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:07.325528 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:28:07.326017 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:07.325583 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:28:07.326017 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:07.325953 2559 scope.go:117] "RemoveContainer" containerID="e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66" May 28 18:28:07.326153 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:07.326132 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-6fzbj_openshift-console-operator(31e687ed-4778-415d-a9b1-21ae28ebb824)\"" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podUID="31e687ed-4778-415d-a9b1-21ae28ebb824" May 28 18:28:10.636654 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:10.636617 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:28:10.637059 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:10.636749 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 18:28:10.637059 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:10.636807 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs podName:f00a9ddf-54b4-4627-9009-1cdd4e57125d nodeName:}" failed. No retries permitted until 2026-05-28 18:30:12.636793206 +0000 UTC m=+252.310928805 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs") pod "network-metrics-daemon-zqnxr" (UID: "f00a9ddf-54b4-4627-9009-1cdd4e57125d") : secret "metrics-daemon-secret" not found May 28 18:28:12.754732 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:12.754700 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:28:12.754732 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:12.754740 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:12.755310 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:12.754758 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:12.755310 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:12.754861 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 18:28:12.755310 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:12.754886 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle podName:2ceb4be7-01b2-4f34-babf-c42b2a24931a nodeName:}" failed. No retries permitted until 2026-05-28 18:28:28.754865739 +0000 UTC m=+148.429001340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle") pod "router-default-89bfcb4fb-nzlzm" (UID: "2ceb4be7-01b2-4f34-babf-c42b2a24931a") : configmap references non-existent config key: service-ca.crt May 28 18:28:12.755310 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:12.754930 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls podName:90f5d168-859e-4381-afd8-5705fef932e2 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:28.754912137 +0000 UTC m=+148.429047740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jt84g" (UID: "90f5d168-859e-4381-afd8-5705fef932e2") : secret "cluster-monitoring-operator-tls" not found May 28 18:28:12.757195 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:12.757173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ceb4be7-01b2-4f34-babf-c42b2a24931a-metrics-certs\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:22.932404 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:22.932368 2559 scope.go:117] "RemoveContainer" containerID="e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66" May 28 18:28:23.358833 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:23.358755 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:28:23.359131 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:23.359115 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/1.log" May 28 18:28:23.359178 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:23.359150 2559 generic.go:358] "Generic (PLEG): container finished" podID="31e687ed-4778-415d-a9b1-21ae28ebb824" containerID="97e4af4d007f8c343127f5799cf3b8f896cbd63a745911b1e732bdf1d8573812" exitCode=255 May 28 18:28:23.359212 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:23.359192 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" event={"ID":"31e687ed-4778-415d-a9b1-21ae28ebb824","Type":"ContainerDied","Data":"97e4af4d007f8c343127f5799cf3b8f896cbd63a745911b1e732bdf1d8573812"} May 28 18:28:23.359249 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:23.359224 2559 scope.go:117] "RemoveContainer" containerID="e6f3b2899513298543ea4483d68f622448e7031a6cc53437dfa53c251aac4f66" May 28 18:28:23.359624 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:23.359603 2559 scope.go:117] "RemoveContainer" containerID="97e4af4d007f8c343127f5799cf3b8f896cbd63a745911b1e732bdf1d8573812" May 28 18:28:23.359817 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:23.359792 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-6fzbj_openshift-console-operator(31e687ed-4778-415d-a9b1-21ae28ebb824)\"" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podUID="31e687ed-4778-415d-a9b1-21ae28ebb824" May 28 18:28:24.362848 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:24.362821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:28:25.604799 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.604769 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wb6kn"] May 28 18:28:25.607481 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.607454 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.611202 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.611182 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 18:28:25.611669 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.611653 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 18:28:25.612353 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.612337 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 18:28:25.613827 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.613805 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 18:28:25.614049 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.614034 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w6q6\"" May 28 18:28:25.630062 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.630038 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wb6kn"] May 28 18:28:25.667365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.667334 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d74d8d887-rhlk4"] May 28 18:28:25.669521 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.669503 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.672200 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.672172 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 18:28:25.672287 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.672255 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 18:28:25.672503 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.672485 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 18:28:25.674704 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.674686 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtdtx\"" May 28 18:28:25.698668 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.698647 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d74d8d887-rhlk4"] May 28 18:28:25.705608 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.705593 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 18:28:25.751943 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.751916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.752063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.752040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-data-volume\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.752105 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.752068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8hz\" (UniqueName: \"kubernetes.io/projected/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-kube-api-access-bg8hz\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.752105 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.752098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-crio-socket\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.752182 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.752120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852429 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e82561-e28d-4375-ad93-0fc77ae3b15d-registry-certificates\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852531 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852450 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-data-volume\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852531 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852469 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8hz\" (UniqueName: \"kubernetes.io/projected/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-kube-api-access-bg8hz\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852639 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-bound-sa-token\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852639 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852598 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-crio-socket\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852639 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852753 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e82561-e28d-4375-ad93-0fc77ae3b15d-trusted-ca\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852753 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76w9n\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-kube-api-access-76w9n\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852753 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-crio-socket\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852753 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e82561-e28d-4375-ad93-0fc77ae3b15d-ca-trust-extracted\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852753 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e82561-e28d-4375-ad93-0fc77ae3b15d-installation-pull-secrets\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852921 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852784 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852921 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-data-volume\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.852921 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-registry-tls\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.852921 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.852866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e82561-e28d-4375-ad93-0fc77ae3b15d-image-registry-private-configuration\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.853187 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.853169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.854831 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.854791 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.865405 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.865386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8hz\" (UniqueName: \"kubernetes.io/projected/f76d133b-aaac-4d0d-a2b1-d85584bb1d50-kube-api-access-bg8hz\") pod \"insights-runtime-extractor-wb6kn\" (UID: \"f76d133b-aaac-4d0d-a2b1-d85584bb1d50\") " pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.915978 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.915958 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wb6kn" May 28 18:28:25.953997 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.953968 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e82561-e28d-4375-ad93-0fc77ae3b15d-image-registry-private-configuration\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954147 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954053 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e82561-e28d-4375-ad93-0fc77ae3b15d-registry-certificates\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954147 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954119 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-bound-sa-token\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954258 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954154 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e82561-e28d-4375-ad93-0fc77ae3b15d-trusted-ca\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954258 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954179 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76w9n\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-kube-api-access-76w9n\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954258 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954204 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e82561-e28d-4375-ad93-0fc77ae3b15d-ca-trust-extracted\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954258 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954228 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e82561-e28d-4375-ad93-0fc77ae3b15d-installation-pull-secrets\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954467 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954269 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-registry-tls\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.954899 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e82561-e28d-4375-ad93-0fc77ae3b15d-ca-trust-extracted\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.955003 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.954961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e82561-e28d-4375-ad93-0fc77ae3b15d-registry-certificates\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.955182 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.955142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e82561-e28d-4375-ad93-0fc77ae3b15d-trusted-ca\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.956594 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.956422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e82561-e28d-4375-ad93-0fc77ae3b15d-image-registry-private-configuration\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.956807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.956787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-registry-tls\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.957279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.957256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e82561-e28d-4375-ad93-0fc77ae3b15d-installation-pull-secrets\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.969388 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.969364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76w9n\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-kube-api-access-76w9n\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.969595 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.969577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e82561-e28d-4375-ad93-0fc77ae3b15d-bound-sa-token\") pod \"image-registry-6d74d8d887-rhlk4\" (UID: \"27e82561-e28d-4375-ad93-0fc77ae3b15d\") " pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:25.977856 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:25.977808 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:26.048901 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.048871 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wb6kn"] May 28 18:28:26.051961 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:26.051937 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76d133b_aaac_4d0d_a2b1_d85584bb1d50.slice/crio-965ea2f4f52b90a3ee6fe1c183f4e8e6fe8a7bffffe420189df64c388816cf36 WatchSource:0}: Error finding container 965ea2f4f52b90a3ee6fe1c183f4e8e6fe8a7bffffe420189df64c388816cf36: Status 404 returned error can't find the container with id 965ea2f4f52b90a3ee6fe1c183f4e8e6fe8a7bffffe420189df64c388816cf36 May 28 18:28:26.119210 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.119182 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d74d8d887-rhlk4"] May 28 18:28:26.122201 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:26.122176 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e82561_e28d_4375_ad93_0fc77ae3b15d.slice/crio-77e83d9f046f2ded87f5e5c634fb6ceb60868bedf30b01348de987175ccdbb67 WatchSource:0}: Error finding container 77e83d9f046f2ded87f5e5c634fb6ceb60868bedf30b01348de987175ccdbb67: Status 404 returned error can't find the container with id 77e83d9f046f2ded87f5e5c634fb6ceb60868bedf30b01348de987175ccdbb67 May 28 18:28:26.371294 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.371199 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" event={"ID":"27e82561-e28d-4375-ad93-0fc77ae3b15d","Type":"ContainerStarted","Data":"82c4f90e0af1b2f81b8ee458dfc510b629378d2af85253ba5ccf4a0c2fdb6d83"} May 28 18:28:26.371294 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.371240 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" event={"ID":"27e82561-e28d-4375-ad93-0fc77ae3b15d","Type":"ContainerStarted","Data":"77e83d9f046f2ded87f5e5c634fb6ceb60868bedf30b01348de987175ccdbb67"} May 28 18:28:26.371294 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.371284 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:26.372493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.372464 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wb6kn" event={"ID":"f76d133b-aaac-4d0d-a2b1-d85584bb1d50","Type":"ContainerStarted","Data":"00234ce8d8ef5576984b4b6e9a23ac7e8ea6b4feb1811b2119b0844a5c2730cb"} May 28 18:28:26.372493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.372491 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wb6kn" event={"ID":"f76d133b-aaac-4d0d-a2b1-d85584bb1d50","Type":"ContainerStarted","Data":"965ea2f4f52b90a3ee6fe1c183f4e8e6fe8a7bffffe420189df64c388816cf36"} May 28 18:28:26.395775 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:26.395735 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" podStartSLOduration=1.395723644 podStartE2EDuration="1.395723644s" podCreationTimestamp="2026-05-28 18:28:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:28:26.394128989 +0000 UTC m=+146.068264605" watchObservedRunningTime="2026-05-28 18:28:26.395723644 +0000 UTC m=+146.069859256" May 28 18:28:27.326216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:27.326181 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:28:27.326216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:27.326223 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:28:27.326756 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:27.326629 2559 scope.go:117] "RemoveContainer" containerID="97e4af4d007f8c343127f5799cf3b8f896cbd63a745911b1e732bdf1d8573812" May 28 18:28:27.326856 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:27.326833 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-6fzbj_openshift-console-operator(31e687ed-4778-415d-a9b1-21ae28ebb824)\"" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podUID="31e687ed-4778-415d-a9b1-21ae28ebb824" May 28 18:28:27.376669 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:27.376637 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wb6kn" event={"ID":"f76d133b-aaac-4d0d-a2b1-d85584bb1d50","Type":"ContainerStarted","Data":"6247261ef041efba0890a01b8d33fefd7337051d2aee249014b9ccb0e76d7dc9"} May 28 18:28:28.381109 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:28.381025 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wb6kn" event={"ID":"f76d133b-aaac-4d0d-a2b1-d85584bb1d50","Type":"ContainerStarted","Data":"a807374a5522114d906b1dcf527b781dc50240f4996fc1162148e800da102de1"} May 28 18:28:28.400550 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:28.400492 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wb6kn" podStartSLOduration=1.530409311 podStartE2EDuration="3.400480316s" podCreationTimestamp="2026-05-28 18:28:25 +0000 UTC" firstStartedPulling="2026-05-28 18:28:26.105345525 +0000 UTC m=+145.779481125" lastFinishedPulling="2026-05-28 18:28:27.975416534 +0000 UTC m=+147.649552130" observedRunningTime="2026-05-28 18:28:28.399131312 +0000 UTC m=+148.073266930" watchObservedRunningTime="2026-05-28 18:28:28.400480316 +0000 UTC m=+148.074615931" May 28 18:28:28.778914 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:28.778873 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:28.779084 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:28.778951 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:28:28.779474 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:28.779450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ceb4be7-01b2-4f34-babf-c42b2a24931a-service-ca-bundle\") pod \"router-default-89bfcb4fb-nzlzm\" (UID: \"2ceb4be7-01b2-4f34-babf-c42b2a24931a\") " pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:28.781205 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:28.781189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/90f5d168-859e-4381-afd8-5705fef932e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jt84g\" (UID: \"90f5d168-859e-4381-afd8-5705fef932e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:28:29.028026 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.027992 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6qbg7\"" May 28 18:28:29.034840 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.034797 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" May 28 18:28:29.040194 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.040174 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fkxwd\"" May 28 18:28:29.047953 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.047925 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:29.192073 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.170218 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g"] May 28 18:28:29.193614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.193494 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-89bfcb4fb-nzlzm"] May 28 18:28:29.196336 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:29.196313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ceb4be7_01b2_4f34_babf_c42b2a24931a.slice/crio-e470ffcda7babda32bfb6790c5282136f528669209f580e104d640b38dcf7478 WatchSource:0}: Error finding container e470ffcda7babda32bfb6790c5282136f528669209f580e104d640b38dcf7478: Status 404 returned error can't find the container with id e470ffcda7babda32bfb6790c5282136f528669209f580e104d640b38dcf7478 May 28 18:28:29.384798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.384723 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" event={"ID":"2ceb4be7-01b2-4f34-babf-c42b2a24931a","Type":"ContainerStarted","Data":"24edb203cc8f1c1e7f0f6005a6553f66ea2ae5307d6ca661a7733cbeff218598"} May 28 18:28:29.384798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.384762 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" event={"ID":"2ceb4be7-01b2-4f34-babf-c42b2a24931a","Type":"ContainerStarted","Data":"e470ffcda7babda32bfb6790c5282136f528669209f580e104d640b38dcf7478"} May 28 18:28:29.385723 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.385700 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" event={"ID":"90f5d168-859e-4381-afd8-5705fef932e2","Type":"ContainerStarted","Data":"171bbb72e56c70bf75c661d22389860c57ba1643f5b6f3c45b4c08cc6a34a237"} May 28 18:28:29.405062 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:29.405017 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" podStartSLOduration=33.405005884 podStartE2EDuration="33.405005884s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:28:29.403627287 +0000 UTC m=+149.077762920" watchObservedRunningTime="2026-05-28 18:28:29.405005884 +0000 UTC m=+149.079141498" May 28 18:28:30.048700 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:30.048667 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:30.051216 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:30.051195 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:30.387983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:30.387911 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:30.389131 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:30.389108 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-89bfcb4fb-nzlzm" May 28 18:28:31.391400 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.391311 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" event={"ID":"90f5d168-859e-4381-afd8-5705fef932e2","Type":"ContainerStarted","Data":"23c570d81fa19dedc442e2dbc5285310d81669eea9f51480b132796defb8fd39"} May 28 18:28:31.409926 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.409884 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jt84g" podStartSLOduration=33.62384694 podStartE2EDuration="35.409873016s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:28:29.193889764 +0000 UTC m=+148.868025358" lastFinishedPulling="2026-05-28 18:28:30.979915825 +0000 UTC m=+150.654051434" observedRunningTime="2026-05-28 18:28:31.408886705 +0000 UTC m=+151.083022323" watchObservedRunningTime="2026-05-28 18:28:31.409873016 +0000 UTC m=+151.084008662" May 28 18:28:31.484783 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.484750 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9"] May 28 18:28:31.486959 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.486942 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:31.490025 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.489993 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 28 18:28:31.490225 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.490207 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4l7cp\"" May 28 18:28:31.495426 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.495356 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9"] May 28 18:28:31.509383 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.509363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/06fe9fea-e988-4c15-a208-8e0ea16c0678-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-phlm9\" (UID: \"06fe9fea-e988-4c15-a208-8e0ea16c0678\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:31.610551 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.610505 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/06fe9fea-e988-4c15-a208-8e0ea16c0678-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-phlm9\" (UID: \"06fe9fea-e988-4c15-a208-8e0ea16c0678\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:31.612806 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.612781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/06fe9fea-e988-4c15-a208-8e0ea16c0678-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-phlm9\" (UID: \"06fe9fea-e988-4c15-a208-8e0ea16c0678\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:31.796323 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.796293 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:31.912765 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:31.912738 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9"] May 28 18:28:31.915932 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:31.915896 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06fe9fea_e988_4c15_a208_8e0ea16c0678.slice/crio-c240ee910d054d1bdb2d4b4f54e6615b9b826a29e3c87a19c268c69a56b2e88e WatchSource:0}: Error finding container c240ee910d054d1bdb2d4b4f54e6615b9b826a29e3c87a19c268c69a56b2e88e: Status 404 returned error can't find the container with id c240ee910d054d1bdb2d4b4f54e6615b9b826a29e3c87a19c268c69a56b2e88e May 28 18:28:32.395456 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:32.395411 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" event={"ID":"06fe9fea-e988-4c15-a208-8e0ea16c0678","Type":"ContainerStarted","Data":"c240ee910d054d1bdb2d4b4f54e6615b9b826a29e3c87a19c268c69a56b2e88e"} May 28 18:28:33.398861 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:33.398823 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" event={"ID":"06fe9fea-e988-4c15-a208-8e0ea16c0678","Type":"ContainerStarted","Data":"b2c3e917abe70e53283a646ddf25ce4687dd11ffee396251bb25655654a1d430"} May 28 18:28:33.399242 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:33.399056 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:33.403476 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:33.403457 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" May 28 18:28:33.416146 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:33.416101 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-phlm9" podStartSLOduration=1.548803133 podStartE2EDuration="2.416090391s" podCreationTimestamp="2026-05-28 18:28:31 +0000 UTC" firstStartedPulling="2026-05-28 18:28:31.917875469 +0000 UTC m=+151.592011061" lastFinishedPulling="2026-05-28 18:28:32.785162717 +0000 UTC m=+152.459298319" observedRunningTime="2026-05-28 18:28:33.415233911 +0000 UTC m=+153.089369527" watchObservedRunningTime="2026-05-28 18:28:33.416090391 +0000 UTC m=+153.090226005" May 28 18:28:37.257792 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:37.257756 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nqcr8" podUID="6f614b2f-6dea-4d48-849e-da6175b5cd2f" May 28 18:28:37.281081 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:37.281046 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7w95w" podUID="41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c" May 28 18:28:37.409745 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.409718 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqcr8" May 28 18:28:37.892580 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.892526 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7"] May 28 18:28:37.895249 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.895232 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:37.898081 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.898059 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 28 18:28:37.898551 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.898366 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 28 18:28:37.899172 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.899151 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zx9d6\"" May 28 18:28:37.899172 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.899163 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 18:28:37.906448 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.906425 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7"] May 28 18:28:37.928455 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.928433 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2fl4z"] May 28 18:28:37.930861 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.930843 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4"] May 28 18:28:37.930997 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.930980 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.933439 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.933422 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.934397 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.934377 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 18:28:37.934844 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.934819 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 18:28:37.934940 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.934916 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfg6h\"" May 28 18:28:37.934940 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.934932 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 18:28:37.938817 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.938720 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zxfl8\"" May 28 18:28:37.938922 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.938884 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 28 18:28:37.938922 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.938911 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 28 18:28:37.939877 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.939859 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 28 18:28:37.943042 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:37.943013 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zqnxr" podUID="f00a9ddf-54b4-4627-9009-1cdd4e57125d" May 28 18:28:37.947946 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.947927 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4"] May 28 18:28:37.960219 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.960306 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6bab445-c28b-467c-942a-3403c456a507-metrics-client-ca\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960306 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-textfile\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960306 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-tls\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960432 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xvsk\" (UniqueName: \"kubernetes.io/projected/e6bab445-c28b-467c-942a-3403c456a507-kube-api-access-2xvsk\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960432 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d688536b-0a33-4f5d-b794-949a52aba7dc-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.960432 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845fz\" (UniqueName: \"kubernetes.io/projected/e9cb5e2f-aa64-442d-979d-8f150c02bb24-kube-api-access-845fz\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:37.960432 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-wtmp\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb5e2f-aa64-442d-979d-8f150c02bb24-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:37.960641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-accelerators-collector-config\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d2sn\" (UniqueName: \"kubernetes.io/projected/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-api-access-4d2sn\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.960641 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d688536b-0a33-4f5d-b794-949a52aba7dc-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.960836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.960836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-root\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:37.960836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:37.960836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-sys\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.960836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:37.961042 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:37.960882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.061621 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061578 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-textfile\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.061621 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061616 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-tls\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.061835 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061639 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xvsk\" (UniqueName: \"kubernetes.io/projected/e6bab445-c28b-467c-942a-3403c456a507-kube-api-access-2xvsk\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.061835 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061809 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d688536b-0a33-4f5d-b794-949a52aba7dc-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.061944 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-845fz\" (UniqueName: \"kubernetes.io/projected/e9cb5e2f-aa64-442d-979d-8f150c02bb24-kube-api-access-845fz\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.061944 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061913 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-wtmp\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.062041 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061942 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb5e2f-aa64-442d-979d-8f150c02bb24-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.062041 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-textfile\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.062041 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.061979 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-accelerators-collector-config\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.062041 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062031 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4d2sn\" (UniqueName: \"kubernetes.io/projected/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-api-access-4d2sn\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.062234 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062066 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d688536b-0a33-4f5d-b794-949a52aba7dc-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.062668 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-accelerators-collector-config\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.062773 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062663 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.062773 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062572 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d688536b-0a33-4f5d-b794-949a52aba7dc-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.062773 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062720 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-root\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.062773 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d688536b-0a33-4f5d-b794-949a52aba7dc-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.062773 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062751 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062832 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-sys\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062858 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062903 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb5e2f-aa64-442d-979d-8f150c02bb24-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062964 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062991 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6bab445-c28b-467c-942a-3403c456a507-metrics-client-ca\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.063021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062998 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-sys\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.063411 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:38.063111 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 28 18:28:38.063411 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:38.063152 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 28 18:28:38.063411 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:38.063208 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-tls podName:d688536b-0a33-4f5d-b794-949a52aba7dc nodeName:}" failed. No retries permitted until 2026-05-28 18:28:38.56318919 +0000 UTC m=+158.237324799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-wmll4" (UID: "d688536b-0a33-4f5d-b794-949a52aba7dc") : secret "kube-state-metrics-tls" not found May 28 18:28:38.063411 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.063218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.063411 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:38.063227 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-tls podName:e9cb5e2f-aa64-442d-979d-8f150c02bb24 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:38.563217634 +0000 UTC m=+158.237353230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-nk9t7" (UID: "e9cb5e2f-aa64-442d-979d-8f150c02bb24") : secret "openshift-state-metrics-tls" not found May 28 18:28:38.063747 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.062076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-wtmp\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.063747 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.063568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6bab445-c28b-467c-942a-3403c456a507-root\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.063747 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.063681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6bab445-c28b-467c-942a-3403c456a507-metrics-client-ca\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.064686 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.064661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-tls\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.065724 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.065701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6bab445-c28b-467c-942a-3403c456a507-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.065724 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.065712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.065925 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.065905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.071178 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.071155 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xvsk\" (UniqueName: \"kubernetes.io/projected/e6bab445-c28b-467c-942a-3403c456a507-kube-api-access-2xvsk\") pod \"node-exporter-2fl4z\" (UID: \"e6bab445-c28b-467c-942a-3403c456a507\") " pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.071718 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.071695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-845fz\" (UniqueName: \"kubernetes.io/projected/e9cb5e2f-aa64-442d-979d-8f150c02bb24-kube-api-access-845fz\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.075404 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.075382 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d2sn\" (UniqueName: \"kubernetes.io/projected/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-api-access-4d2sn\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.242342 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.242309 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2fl4z" May 28 18:28:38.250834 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:38.250793 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bab445_c28b_467c_942a_3403c456a507.slice/crio-8aff7a85c913f65bb7237c937d897d9e5add369187e4a0e5c19e08316d8783a9 WatchSource:0}: Error finding container 8aff7a85c913f65bb7237c937d897d9e5add369187e4a0e5c19e08316d8783a9: Status 404 returned error can't find the container with id 8aff7a85c913f65bb7237c937d897d9e5add369187e4a0e5c19e08316d8783a9 May 28 18:28:38.413666 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.413629 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fl4z" event={"ID":"e6bab445-c28b-467c-942a-3403c456a507","Type":"ContainerStarted","Data":"8aff7a85c913f65bb7237c937d897d9e5add369187e4a0e5c19e08316d8783a9"} May 28 18:28:38.568351 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.568281 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.568351 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.568335 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.570848 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.570826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d688536b-0a33-4f5d-b794-949a52aba7dc-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wmll4\" (UID: \"d688536b-0a33-4f5d-b794-949a52aba7dc\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:38.571282 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.571263 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9cb5e2f-aa64-442d-979d-8f150c02bb24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-nk9t7\" (UID: \"e9cb5e2f-aa64-442d-979d-8f150c02bb24\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.807344 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.807306 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" May 28 18:28:38.847211 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:38.847110 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" May 28 18:28:39.032133 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:39.032105 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4"] May 28 18:28:39.034654 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:39.034628 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd688536b_0a33_4f5d_b794_949a52aba7dc.slice/crio-37dc34c67c61a34d11c9eac81c1f80a5b0b9f0d34bb89831cccba66a4bc5aec3 WatchSource:0}: Error finding container 37dc34c67c61a34d11c9eac81c1f80a5b0b9f0d34bb89831cccba66a4bc5aec3: Status 404 returned error can't find the container with id 37dc34c67c61a34d11c9eac81c1f80a5b0b9f0d34bb89831cccba66a4bc5aec3 May 28 18:28:39.184292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:39.184253 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7"] May 28 18:28:39.269103 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:39.269063 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cb5e2f_aa64_442d_979d_8f150c02bb24.slice/crio-82bb24f4e000b4a69e2babaea112e5849f51de1a2d3bace1ca10ce3aa62f89b7 WatchSource:0}: Error finding container 82bb24f4e000b4a69e2babaea112e5849f51de1a2d3bace1ca10ce3aa62f89b7: Status 404 returned error can't find the container with id 82bb24f4e000b4a69e2babaea112e5849f51de1a2d3bace1ca10ce3aa62f89b7 May 28 18:28:39.418591 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:39.418559 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fl4z" event={"ID":"e6bab445-c28b-467c-942a-3403c456a507","Type":"ContainerStarted","Data":"c2d7c7cdedbe565251239b44eeb9685a91e0a32e5aae8d149f19f9afe61a2056"} May 28 18:28:39.419987 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:39.419961 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" event={"ID":"d688536b-0a33-4f5d-b794-949a52aba7dc","Type":"ContainerStarted","Data":"37dc34c67c61a34d11c9eac81c1f80a5b0b9f0d34bb89831cccba66a4bc5aec3"} May 28 18:28:39.422160 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:39.422135 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" event={"ID":"e9cb5e2f-aa64-442d-979d-8f150c02bb24","Type":"ContainerStarted","Data":"72ec8af554add66dfc83ef8b09ce2ad22fbf3ddac8f21d6e96b221350a690c64"} May 28 18:28:39.422259 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:39.422166 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" event={"ID":"e9cb5e2f-aa64-442d-979d-8f150c02bb24","Type":"ContainerStarted","Data":"82bb24f4e000b4a69e2babaea112e5849f51de1a2d3bace1ca10ce3aa62f89b7"} May 28 18:28:40.427033 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:40.426994 2559 generic.go:358] "Generic (PLEG): container finished" podID="e6bab445-c28b-467c-942a-3403c456a507" containerID="c2d7c7cdedbe565251239b44eeb9685a91e0a32e5aae8d149f19f9afe61a2056" exitCode=0 May 28 18:28:40.427444 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:40.427040 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fl4z" event={"ID":"e6bab445-c28b-467c-942a-3403c456a507","Type":"ContainerDied","Data":"c2d7c7cdedbe565251239b44eeb9685a91e0a32e5aae8d149f19f9afe61a2056"} May 28 18:28:40.428859 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:40.428837 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" event={"ID":"e9cb5e2f-aa64-442d-979d-8f150c02bb24","Type":"ContainerStarted","Data":"beb744bc4428f6ae60ee47f4c1a2fb2055e6fdf78208e742526dc11855ff6182"} May 28 18:28:41.434126 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.434086 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fl4z" event={"ID":"e6bab445-c28b-467c-942a-3403c456a507","Type":"ContainerStarted","Data":"fbe8e053b6c1d676bb338b2838e9d51406d41ea586e07696d33dfcfc5d9086fe"} May 28 18:28:41.434578 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.434134 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2fl4z" event={"ID":"e6bab445-c28b-467c-942a-3403c456a507","Type":"ContainerStarted","Data":"a0a22bd269078cac0030bc7e48e89c517ff734077f8f3501a3f7d58089a6a7f8"} May 28 18:28:41.436193 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.436165 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" event={"ID":"d688536b-0a33-4f5d-b794-949a52aba7dc","Type":"ContainerStarted","Data":"24d2c1433f3566262e94942996dd90d66679f7ef685c64dfd5de00cfdde06a8f"} May 28 18:28:41.436292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.436202 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" event={"ID":"d688536b-0a33-4f5d-b794-949a52aba7dc","Type":"ContainerStarted","Data":"82f54762483dfd7b18871987474d46e2abdd26ae91c720bd6923a53d94885384"} May 28 18:28:41.436292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.436218 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" event={"ID":"d688536b-0a33-4f5d-b794-949a52aba7dc","Type":"ContainerStarted","Data":"bd6c11f085be22c29899c0063659b141ca8e17caa660dd48b9a5e06dd4f21880"} May 28 18:28:41.437983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.437963 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" event={"ID":"e9cb5e2f-aa64-442d-979d-8f150c02bb24","Type":"ContainerStarted","Data":"ac4b14e5b907e4f39cc3c7f8d311308b1bede16329eac7cdecacf6c623bf27d8"} May 28 18:28:41.462545 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.462486 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2fl4z" podStartSLOduration=3.418215482 podStartE2EDuration="4.46247014s" podCreationTimestamp="2026-05-28 18:28:37 +0000 UTC" firstStartedPulling="2026-05-28 18:28:38.253046449 +0000 UTC m=+157.927182057" lastFinishedPulling="2026-05-28 18:28:39.297301107 +0000 UTC m=+158.971436715" observedRunningTime="2026-05-28 18:28:41.460183161 +0000 UTC m=+161.134318777" watchObservedRunningTime="2026-05-28 18:28:41.46247014 +0000 UTC m=+161.136605756" May 28 18:28:41.481250 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.481205 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wmll4" podStartSLOduration=3.008863663 podStartE2EDuration="4.481192929s" podCreationTimestamp="2026-05-28 18:28:37 +0000 UTC" firstStartedPulling="2026-05-28 18:28:39.036687155 +0000 UTC m=+158.710822754" lastFinishedPulling="2026-05-28 18:28:40.509016424 +0000 UTC m=+160.183152020" observedRunningTime="2026-05-28 18:28:41.480181301 +0000 UTC m=+161.154316916" watchObservedRunningTime="2026-05-28 18:28:41.481192929 +0000 UTC m=+161.155328558" May 28 18:28:41.499126 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.499087 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-nk9t7" podStartSLOduration=3.417563511 podStartE2EDuration="4.499075833s" podCreationTimestamp="2026-05-28 18:28:37 +0000 UTC" firstStartedPulling="2026-05-28 18:28:39.428870806 +0000 UTC m=+159.103006399" lastFinishedPulling="2026-05-28 18:28:40.510383122 +0000 UTC m=+160.184518721" observedRunningTime="2026-05-28 18:28:41.498256507 +0000 UTC m=+161.172392124" watchObservedRunningTime="2026-05-28 18:28:41.499075833 +0000 UTC m=+161.173211448" May 28 18:28:41.929780 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:41.929750 2559 scope.go:117] "RemoveContainer" containerID="97e4af4d007f8c343127f5799cf3b8f896cbd63a745911b1e732bdf1d8573812" May 28 18:28:41.929947 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:28:41.929922 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-6fzbj_openshift-console-operator(31e687ed-4778-415d-a9b1-21ae28ebb824)\"" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podUID="31e687ed-4778-415d-a9b1-21ae28ebb824" May 28 18:28:42.203190 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.203106 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:28:42.203190 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.203151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:28:42.205463 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.205440 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f614b2f-6dea-4d48-849e-da6175b5cd2f-metrics-tls\") pod \"dns-default-nqcr8\" (UID: \"6f614b2f-6dea-4d48-849e-da6175b5cd2f\") " pod="openshift-dns/dns-default-nqcr8" May 28 18:28:42.205592 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.205571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c-cert\") pod \"ingress-canary-7w95w\" (UID: \"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c\") " pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:28:42.213381 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.213362 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpf94\"" May 28 18:28:42.220659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.220640 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqcr8" May 28 18:28:42.345638 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.345616 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqcr8"] May 28 18:28:42.348149 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:42.348116 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f614b2f_6dea_4d48_849e_da6175b5cd2f.slice/crio-7462d692c1c2953dea28714801f3171ad9cbf91520b4f08376d7a5e34d5d5aa5 WatchSource:0}: Error finding container 7462d692c1c2953dea28714801f3171ad9cbf91520b4f08376d7a5e34d5d5aa5: Status 404 returned error can't find the container with id 7462d692c1c2953dea28714801f3171ad9cbf91520b4f08376d7a5e34d5d5aa5 May 28 18:28:42.389082 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.389058 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77b499c556-qrvbb"] May 28 18:28:42.392055 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.392040 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.395687 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.395594 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 28 18:28:42.395687 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.395636 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 28 18:28:42.395687 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.395650 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 28 18:28:42.395687 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.395654 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2pohc4cquhvtp\"" May 28 18:28:42.395912 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.395726 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jjgk4\"" May 28 18:28:42.395912 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.395654 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 18:28:42.400408 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.400389 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77b499c556-qrvbb"] May 28 18:28:42.441846 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.441823 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqcr8" event={"ID":"6f614b2f-6dea-4d48-849e-da6175b5cd2f","Type":"ContainerStarted","Data":"7462d692c1c2953dea28714801f3171ad9cbf91520b4f08376d7a5e34d5d5aa5"} May 28 18:28:42.505899 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.505843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/97de5bd9-9b91-47a1-8455-1a3021da0645-metrics-server-audit-profiles\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.505899 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.505882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-secret-metrics-server-client-certs\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.506047 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.505899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97de5bd9-9b91-47a1-8455-1a3021da0645-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.506047 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.506035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grc5g\" (UniqueName: \"kubernetes.io/projected/97de5bd9-9b91-47a1-8455-1a3021da0645-kube-api-access-grc5g\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.506224 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.506198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-secret-metrics-server-tls\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.506373 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.506347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/97de5bd9-9b91-47a1-8455-1a3021da0645-audit-log\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.506473 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.506396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-client-ca-bundle\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607158 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607132 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-secret-metrics-server-tls\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607278 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607161 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/97de5bd9-9b91-47a1-8455-1a3021da0645-audit-log\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607278 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-client-ca-bundle\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607414 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607337 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/97de5bd9-9b91-47a1-8455-1a3021da0645-metrics-server-audit-profiles\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607414 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607379 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-secret-metrics-server-client-certs\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607594 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607567 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97de5bd9-9b91-47a1-8455-1a3021da0645-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607663 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/97de5bd9-9b91-47a1-8455-1a3021da0645-audit-log\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.607663 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.607657 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grc5g\" (UniqueName: \"kubernetes.io/projected/97de5bd9-9b91-47a1-8455-1a3021da0645-kube-api-access-grc5g\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.608468 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.608438 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97de5bd9-9b91-47a1-8455-1a3021da0645-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.608623 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.608603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/97de5bd9-9b91-47a1-8455-1a3021da0645-metrics-server-audit-profiles\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.609802 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.609781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-secret-metrics-server-client-certs\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.609897 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.609811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-client-ca-bundle\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.609897 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.609889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/97de5bd9-9b91-47a1-8455-1a3021da0645-secret-metrics-server-tls\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.621510 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.621484 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grc5g\" (UniqueName: \"kubernetes.io/projected/97de5bd9-9b91-47a1-8455-1a3021da0645-kube-api-access-grc5g\") pod \"metrics-server-77b499c556-qrvbb\" (UID: \"97de5bd9-9b91-47a1-8455-1a3021da0645\") " pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.701354 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.701323 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:28:42.826733 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:42.825165 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77b499c556-qrvbb"] May 28 18:28:42.830118 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:42.830092 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97de5bd9_9b91_47a1_8455_1a3021da0645.slice/crio-519399dbe11a894d8ec581c0dd3107f8db3bde3bd0efc0e50513abebbe6262dd WatchSource:0}: Error finding container 519399dbe11a894d8ec581c0dd3107f8db3bde3bd0efc0e50513abebbe6262dd: Status 404 returned error can't find the container with id 519399dbe11a894d8ec581c0dd3107f8db3bde3bd0efc0e50513abebbe6262dd May 28 18:28:43.447258 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:43.447201 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" event={"ID":"97de5bd9-9b91-47a1-8455-1a3021da0645","Type":"ContainerStarted","Data":"519399dbe11a894d8ec581c0dd3107f8db3bde3bd0efc0e50513abebbe6262dd"} May 28 18:28:44.451660 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:44.451625 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqcr8" event={"ID":"6f614b2f-6dea-4d48-849e-da6175b5cd2f","Type":"ContainerStarted","Data":"99a272e19d00179b12c6035d46e969692a39a2930ab542941667520425d9e680"} May 28 18:28:44.452044 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:44.451668 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqcr8" event={"ID":"6f614b2f-6dea-4d48-849e-da6175b5cd2f","Type":"ContainerStarted","Data":"77ff85b628001b3666185500284c991e656877530126c09d097073725afc9f03"} May 28 18:28:44.452044 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:44.451767 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nqcr8" May 28 18:28:44.452958 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:44.452933 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" event={"ID":"97de5bd9-9b91-47a1-8455-1a3021da0645","Type":"ContainerStarted","Data":"37211b02d2f622602cf64da0e2e2916802863584d9a0aeb1e5d680ae1d0fadf4"} May 28 18:28:44.469748 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:44.469696 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nqcr8" podStartSLOduration=129.055028123 podStartE2EDuration="2m10.46968355s" podCreationTimestamp="2026-05-28 18:26:34 +0000 UTC" firstStartedPulling="2026-05-28 18:28:42.350000518 +0000 UTC m=+162.024136115" lastFinishedPulling="2026-05-28 18:28:43.764655949 +0000 UTC m=+163.438791542" observedRunningTime="2026-05-28 18:28:44.468642044 +0000 UTC m=+164.142777659" watchObservedRunningTime="2026-05-28 18:28:44.46968355 +0000 UTC m=+164.143819164" May 28 18:28:44.491170 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:44.491124 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" podStartSLOduration=0.98810938 podStartE2EDuration="2.491110373s" podCreationTimestamp="2026-05-28 18:28:42 +0000 UTC" firstStartedPulling="2026-05-28 18:28:42.83212455 +0000 UTC m=+162.506260143" lastFinishedPulling="2026-05-28 18:28:44.335125534 +0000 UTC m=+164.009261136" observedRunningTime="2026-05-28 18:28:44.490972951 +0000 UTC m=+164.165108568" watchObservedRunningTime="2026-05-28 18:28:44.491110373 +0000 UTC m=+164.165245989" May 28 18:28:47.381378 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:47.381299 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d74d8d887-rhlk4" May 28 18:28:47.929747 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:47.929715 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:28:47.932611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:47.932589 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7dfk\"" May 28 18:28:47.940749 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:47.940730 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7w95w" May 28 18:28:48.059930 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:48.059773 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7w95w"] May 28 18:28:48.064157 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:48.064126 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e0807d_ceb0_4eaa_a90d_5d302a2a5d9c.slice/crio-8bdef59891a7630ba593a73b691a014c0d6410369b23224b8fcdcd8143f7d71f WatchSource:0}: Error finding container 8bdef59891a7630ba593a73b691a014c0d6410369b23224b8fcdcd8143f7d71f: Status 404 returned error can't find the container with id 8bdef59891a7630ba593a73b691a014c0d6410369b23224b8fcdcd8143f7d71f May 28 18:28:48.469347 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:48.469307 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7w95w" event={"ID":"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c","Type":"ContainerStarted","Data":"8bdef59891a7630ba593a73b691a014c0d6410369b23224b8fcdcd8143f7d71f"} May 28 18:28:50.479046 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:50.477834 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7w95w" event={"ID":"41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c","Type":"ContainerStarted","Data":"06000cc83e19e83fe862635da26567b6e91682fbe2f56efa783f78d18a04ef62"} May 28 18:28:50.930783 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:50.930748 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:28:52.929787 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:52.929755 2559 scope.go:117] "RemoveContainer" containerID="97e4af4d007f8c343127f5799cf3b8f896cbd63a745911b1e732bdf1d8573812" May 28 18:28:53.487606 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.487575 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:28:53.487798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.487672 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" event={"ID":"31e687ed-4778-415d-a9b1-21ae28ebb824","Type":"ContainerStarted","Data":"9b359020a28b3c7c7491cff293f1506e4ca30d2fda82a3689f658e3a59cfe2e9"} May 28 18:28:53.487959 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.487936 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:28:53.492619 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.492596 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" May 28 18:28:53.504193 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.504141 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7w95w" podStartSLOduration=138.070670504 podStartE2EDuration="2m19.504129899s" podCreationTimestamp="2026-05-28 18:26:34 +0000 UTC" firstStartedPulling="2026-05-28 18:28:48.06584127 +0000 UTC m=+167.739976863" lastFinishedPulling="2026-05-28 18:28:49.499300666 +0000 UTC m=+169.173436258" observedRunningTime="2026-05-28 18:28:50.493354421 +0000 UTC m=+170.167490035" watchObservedRunningTime="2026-05-28 18:28:53.504129899 +0000 UTC m=+173.178265517" May 28 18:28:53.504763 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.504738 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-6fzbj" podStartSLOduration=55.70658467 podStartE2EDuration="57.50472993s" podCreationTimestamp="2026-05-28 18:27:56 +0000 UTC" firstStartedPulling="2026-05-28 18:27:57.453883782 +0000 UTC m=+117.128019375" lastFinishedPulling="2026-05-28 18:27:59.252029036 +0000 UTC m=+118.926164635" observedRunningTime="2026-05-28 18:28:53.502954955 +0000 UTC m=+173.177090570" watchObservedRunningTime="2026-05-28 18:28:53.50472993 +0000 UTC m=+173.178865545" May 28 18:28:53.626909 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.626877 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-tw2rn"] May 28 18:28:53.629141 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.629118 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:28:53.631793 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.631773 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-82jxz\"" May 28 18:28:53.631911 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.631856 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 18:28:53.631969 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.631938 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 18:28:53.641555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.641514 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-tw2rn"] May 28 18:28:53.695228 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.695200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td7zs\" (UniqueName: \"kubernetes.io/projected/b8714cbd-fca2-43e7-8dc0-58f92bdc16ba-kube-api-access-td7zs\") pod \"downloads-57bd96b888-tw2rn\" (UID: \"b8714cbd-fca2-43e7-8dc0-58f92bdc16ba\") " pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:28:53.795652 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.795592 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-td7zs\" (UniqueName: \"kubernetes.io/projected/b8714cbd-fca2-43e7-8dc0-58f92bdc16ba-kube-api-access-td7zs\") pod \"downloads-57bd96b888-tw2rn\" (UID: \"b8714cbd-fca2-43e7-8dc0-58f92bdc16ba\") " pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:28:53.804106 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.804091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td7zs\" (UniqueName: \"kubernetes.io/projected/b8714cbd-fca2-43e7-8dc0-58f92bdc16ba-kube-api-access-td7zs\") pod \"downloads-57bd96b888-tw2rn\" (UID: \"b8714cbd-fca2-43e7-8dc0-58f92bdc16ba\") " pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:28:53.938189 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:53.938148 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:28:54.059035 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:54.058969 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-tw2rn"] May 28 18:28:54.061942 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:28:54.061913 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8714cbd_fca2_43e7_8dc0_58f92bdc16ba.slice/crio-4b9d4e7850c7caccbcddc846719270c46c0cc06c7ecdaac34611116e1ec4376e WatchSource:0}: Error finding container 4b9d4e7850c7caccbcddc846719270c46c0cc06c7ecdaac34611116e1ec4376e: Status 404 returned error can't find the container with id 4b9d4e7850c7caccbcddc846719270c46c0cc06c7ecdaac34611116e1ec4376e May 28 18:28:54.458879 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:54.458856 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nqcr8" May 28 18:28:54.492212 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:28:54.492184 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-tw2rn" event={"ID":"b8714cbd-fca2-43e7-8dc0-58f92bdc16ba","Type":"ContainerStarted","Data":"4b9d4e7850c7caccbcddc846719270c46c0cc06c7ecdaac34611116e1ec4376e"} May 28 18:29:02.702059 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:02.702019 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:29:02.702512 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:02.702070 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:29:03.319750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.319714 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7857c8bbcf-4zlzn"] May 28 18:29:03.325990 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.325965 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.328690 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.328667 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 18:29:03.328817 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.328692 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 18:29:03.328817 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.328796 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 18:29:03.330070 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.330050 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gpznh\"" May 28 18:29:03.330626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.330454 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 18:29:03.330626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.330498 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 18:29:03.332477 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.332455 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7857c8bbcf-4zlzn"] May 28 18:29:03.480634 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.480594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-oauth-config\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.480634 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.480631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-oauth-serving-cert\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.480873 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.480760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-service-ca\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.480873 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.480809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-console-config\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.480954 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.480888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7cvb\" (UniqueName: \"kubernetes.io/projected/497c96f6-23f7-4b72-8a34-25d71d481749-kube-api-access-p7cvb\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.480954 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.480938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-serving-cert\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582080 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582003 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-console-config\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582080 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582037 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7cvb\" (UniqueName: \"kubernetes.io/projected/497c96f6-23f7-4b72-8a34-25d71d481749-kube-api-access-p7cvb\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582080 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582071 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-serving-cert\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582107 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-oauth-config\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582130 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-oauth-serving-cert\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582212 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-service-ca\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582830 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-console-config\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.582935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.582864 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-service-ca\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.583110 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.583081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-oauth-serving-cert\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.584973 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.584948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-oauth-config\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.585047 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.584994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-serving-cert\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.590020 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.589998 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7cvb\" (UniqueName: \"kubernetes.io/projected/497c96f6-23f7-4b72-8a34-25d71d481749-kube-api-access-p7cvb\") pod \"console-7857c8bbcf-4zlzn\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.637854 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.637826 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:03.785304 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:03.785279 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7857c8bbcf-4zlzn"] May 28 18:29:03.788129 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:29:03.788095 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497c96f6_23f7_4b72_8a34_25d71d481749.slice/crio-1c3349b7fce6e6a367ac8db01265f0ab77fbaeb80115b24789b5381a524f7b0f WatchSource:0}: Error finding container 1c3349b7fce6e6a367ac8db01265f0ab77fbaeb80115b24789b5381a524f7b0f: Status 404 returned error can't find the container with id 1c3349b7fce6e6a367ac8db01265f0ab77fbaeb80115b24789b5381a524f7b0f May 28 18:29:04.523075 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:04.523026 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857c8bbcf-4zlzn" event={"ID":"497c96f6-23f7-4b72-8a34-25d71d481749","Type":"ContainerStarted","Data":"1c3349b7fce6e6a367ac8db01265f0ab77fbaeb80115b24789b5381a524f7b0f"} May 28 18:29:11.304995 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.304961 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8fc5469d-479mg"] May 28 18:29:11.308650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.308628 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.316892 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.316695 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 28 18:29:11.318447 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.318422 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8fc5469d-479mg"] May 28 18:29:11.449138 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-trusted-ca-bundle\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.449300 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pbf\" (UniqueName: \"kubernetes.io/projected/259bf8b7-78e3-4472-a955-21d721d7c0fe-kube-api-access-s5pbf\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.449300 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-service-ca\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.449433 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-config\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.449433 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-serving-cert\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.449433 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-oauth-serving-cert\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.449582 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.449464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-oauth-config\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550303 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550266 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-trusted-ca-bundle\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550478 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550313 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pbf\" (UniqueName: \"kubernetes.io/projected/259bf8b7-78e3-4472-a955-21d721d7c0fe-kube-api-access-s5pbf\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550478 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550370 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-service-ca\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550478 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550427 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-config\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550478 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550459 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-serving-cert\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550705 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550489 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-oauth-serving-cert\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.550705 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.550522 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-oauth-config\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.551334 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.551279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-service-ca\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.551334 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.551283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-oauth-serving-cert\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.551334 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.551287 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-trusted-ca-bundle\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.551583 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.551339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-config\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.553412 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.553386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-serving-cert\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.553589 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.553565 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-oauth-config\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.558998 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.558945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pbf\" (UniqueName: \"kubernetes.io/projected/259bf8b7-78e3-4472-a955-21d721d7c0fe-kube-api-access-s5pbf\") pod \"console-5d8fc5469d-479mg\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:11.620883 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:11.620849 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:12.315493 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.315364 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8fc5469d-479mg"] May 28 18:29:12.318009 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:29:12.317976 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259bf8b7_78e3_4472_a955_21d721d7c0fe.slice/crio-83c4ece1570c10b6444e80115b4ed153b820d4f72eb123fa229ba298de1aa68b WatchSource:0}: Error finding container 83c4ece1570c10b6444e80115b4ed153b820d4f72eb123fa229ba298de1aa68b: Status 404 returned error can't find the container with id 83c4ece1570c10b6444e80115b4ed153b820d4f72eb123fa229ba298de1aa68b May 28 18:29:12.548862 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.548773 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8fc5469d-479mg" event={"ID":"259bf8b7-78e3-4472-a955-21d721d7c0fe","Type":"ContainerStarted","Data":"b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0"} May 28 18:29:12.548862 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.548821 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8fc5469d-479mg" event={"ID":"259bf8b7-78e3-4472-a955-21d721d7c0fe","Type":"ContainerStarted","Data":"83c4ece1570c10b6444e80115b4ed153b820d4f72eb123fa229ba298de1aa68b"} May 28 18:29:12.550238 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.550208 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-tw2rn" event={"ID":"b8714cbd-fca2-43e7-8dc0-58f92bdc16ba","Type":"ContainerStarted","Data":"fb3637ad7f04b3eee4989b6768ce2be53d573ad673b6ca806f95be8e9d2bcce8"} May 28 18:29:12.550424 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.550381 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:29:12.551912 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.551848 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857c8bbcf-4zlzn" event={"ID":"497c96f6-23f7-4b72-8a34-25d71d481749","Type":"ContainerStarted","Data":"701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a"} May 28 18:29:12.556929 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.556909 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-tw2rn" May 28 18:29:12.568372 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.568298 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d8fc5469d-479mg" podStartSLOduration=1.568286455 podStartE2EDuration="1.568286455s" podCreationTimestamp="2026-05-28 18:29:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:29:12.565793868 +0000 UTC m=+192.239929495" watchObservedRunningTime="2026-05-28 18:29:12.568286455 +0000 UTC m=+192.242422070" May 28 18:29:12.583807 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.583761 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7857c8bbcf-4zlzn" podStartSLOduration=1.185628943 podStartE2EDuration="9.583749136s" podCreationTimestamp="2026-05-28 18:29:03 +0000 UTC" firstStartedPulling="2026-05-28 18:29:03.790571506 +0000 UTC m=+183.464707104" lastFinishedPulling="2026-05-28 18:29:12.188691689 +0000 UTC m=+191.862827297" observedRunningTime="2026-05-28 18:29:12.58261438 +0000 UTC m=+192.256749996" watchObservedRunningTime="2026-05-28 18:29:12.583749136 +0000 UTC m=+192.257884750" May 28 18:29:12.599412 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:12.599358 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-tw2rn" podStartSLOduration=1.437541594 podStartE2EDuration="19.599343967s" podCreationTimestamp="2026-05-28 18:28:53 +0000 UTC" firstStartedPulling="2026-05-28 18:28:54.063824636 +0000 UTC m=+173.737960230" lastFinishedPulling="2026-05-28 18:29:12.225627002 +0000 UTC m=+191.899762603" observedRunningTime="2026-05-28 18:29:12.597715302 +0000 UTC m=+192.271850918" watchObservedRunningTime="2026-05-28 18:29:12.599343967 +0000 UTC m=+192.273479581" May 28 18:29:13.638251 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:13.638215 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:13.638251 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:13.638257 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:13.643920 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:13.643891 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:14.562916 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:14.562884 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:21.621992 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:21.621959 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:21.622439 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:21.622005 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:21.626882 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:21.626860 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:22.587846 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:22.587821 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:29:22.634006 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:22.633976 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7857c8bbcf-4zlzn"] May 28 18:29:22.707218 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:22.707193 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:29:22.711155 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:22.711133 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77b499c556-qrvbb" May 28 18:29:47.656496 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.656432 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7857c8bbcf-4zlzn" podUID="497c96f6-23f7-4b72-8a34-25d71d481749" containerName="console" containerID="cri-o://701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a" gracePeriod=15 May 28 18:29:47.912956 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.912897 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7857c8bbcf-4zlzn_497c96f6-23f7-4b72-8a34-25d71d481749/console/0.log" May 28 18:29:47.913063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.912982 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:47.978058 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978028 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-serving-cert\") pod \"497c96f6-23f7-4b72-8a34-25d71d481749\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " May 28 18:29:47.978207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978077 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-oauth-serving-cert\") pod \"497c96f6-23f7-4b72-8a34-25d71d481749\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " May 28 18:29:47.978207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978096 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-service-ca\") pod \"497c96f6-23f7-4b72-8a34-25d71d481749\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " May 28 18:29:47.978207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978157 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-oauth-config\") pod \"497c96f6-23f7-4b72-8a34-25d71d481749\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " May 28 18:29:47.978207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978176 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-console-config\") pod \"497c96f6-23f7-4b72-8a34-25d71d481749\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " May 28 18:29:47.978421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978296 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7cvb\" (UniqueName: \"kubernetes.io/projected/497c96f6-23f7-4b72-8a34-25d71d481749-kube-api-access-p7cvb\") pod \"497c96f6-23f7-4b72-8a34-25d71d481749\" (UID: \"497c96f6-23f7-4b72-8a34-25d71d481749\") " May 28 18:29:47.978564 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978516 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "497c96f6-23f7-4b72-8a34-25d71d481749" (UID: "497c96f6-23f7-4b72-8a34-25d71d481749"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:29:47.978564 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978525 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-service-ca" (OuterVolumeSpecName: "service-ca") pod "497c96f6-23f7-4b72-8a34-25d71d481749" (UID: "497c96f6-23f7-4b72-8a34-25d71d481749"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:29:47.978750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978576 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-console-config" (OuterVolumeSpecName: "console-config") pod "497c96f6-23f7-4b72-8a34-25d71d481749" (UID: "497c96f6-23f7-4b72-8a34-25d71d481749"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:29:47.978750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978632 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-oauth-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:29:47.978750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.978653 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-service-ca\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:29:47.980268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.980242 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "497c96f6-23f7-4b72-8a34-25d71d481749" (UID: "497c96f6-23f7-4b72-8a34-25d71d481749"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:47.980685 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.980663 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497c96f6-23f7-4b72-8a34-25d71d481749-kube-api-access-p7cvb" (OuterVolumeSpecName: "kube-api-access-p7cvb") pod "497c96f6-23f7-4b72-8a34-25d71d481749" (UID: "497c96f6-23f7-4b72-8a34-25d71d481749"). InnerVolumeSpecName "kube-api-access-p7cvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:29:47.980748 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:47.980699 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "497c96f6-23f7-4b72-8a34-25d71d481749" (UID: "497c96f6-23f7-4b72-8a34-25d71d481749"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:29:48.079396 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.079366 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7cvb\" (UniqueName: \"kubernetes.io/projected/497c96f6-23f7-4b72-8a34-25d71d481749-kube-api-access-p7cvb\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:29:48.079396 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.079394 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:29:48.079597 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.079407 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/497c96f6-23f7-4b72-8a34-25d71d481749-console-oauth-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:29:48.079597 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.079421 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/497c96f6-23f7-4b72-8a34-25d71d481749-console-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:29:48.659185 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.659163 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7857c8bbcf-4zlzn_497c96f6-23f7-4b72-8a34-25d71d481749/console/0.log" May 28 18:29:48.659656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.659197 2559 generic.go:358] "Generic (PLEG): container finished" podID="497c96f6-23f7-4b72-8a34-25d71d481749" containerID="701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a" exitCode=2 May 28 18:29:48.659656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.659249 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857c8bbcf-4zlzn" event={"ID":"497c96f6-23f7-4b72-8a34-25d71d481749","Type":"ContainerDied","Data":"701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a"} May 28 18:29:48.659656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.659274 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857c8bbcf-4zlzn" event={"ID":"497c96f6-23f7-4b72-8a34-25d71d481749","Type":"ContainerDied","Data":"1c3349b7fce6e6a367ac8db01265f0ab77fbaeb80115b24789b5381a524f7b0f"} May 28 18:29:48.659656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.659289 2559 scope.go:117] "RemoveContainer" containerID="701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a" May 28 18:29:48.659656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.659302 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857c8bbcf-4zlzn" May 28 18:29:48.667246 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.667228 2559 scope.go:117] "RemoveContainer" containerID="701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a" May 28 18:29:48.667490 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:29:48.667470 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a\": container with ID starting with 701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a not found: ID does not exist" containerID="701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a" May 28 18:29:48.667584 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.667496 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a"} err="failed to get container status \"701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a\": rpc error: code = NotFound desc = could not find container \"701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a\": container with ID starting with 701f20c7717f83072b3e77c6185669dca646fce2031e98375641f294358c9c6a not found: ID does not exist" May 28 18:29:48.708145 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.708121 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7857c8bbcf-4zlzn"] May 28 18:29:48.713155 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.713129 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7857c8bbcf-4zlzn"] May 28 18:29:48.933184 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:29:48.933101 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497c96f6-23f7-4b72-8a34-25d71d481749" path="/var/lib/kubelet/pods/497c96f6-23f7-4b72-8a34-25d71d481749/volumes" May 28 18:30:06.186980 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.186943 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f8f8ff858-fb4fk"] May 28 18:30:06.187453 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.187394 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497c96f6-23f7-4b72-8a34-25d71d481749" containerName="console" May 28 18:30:06.187453 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.187415 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="497c96f6-23f7-4b72-8a34-25d71d481749" containerName="console" May 28 18:30:06.187620 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.187562 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="497c96f6-23f7-4b72-8a34-25d71d481749" containerName="console" May 28 18:30:06.191674 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.191653 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.203706 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.203685 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8f8ff858-fb4fk"] May 28 18:30:06.325119 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-trusted-ca-bundle\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.325119 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-oauth-config\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.325292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9spz\" (UniqueName: \"kubernetes.io/projected/03bc1185-05d2-495d-9355-12a5828312fd-kube-api-access-r9spz\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.325292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-console-config\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.325292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-service-ca\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.325292 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-serving-cert\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.325417 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.325326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-oauth-serving-cert\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.425864 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.425838 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-service-ca\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.425864 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.425867 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-serving-cert\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.425898 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-oauth-serving-cert\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.425931 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-trusted-ca-bundle\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.425957 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-oauth-config\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.425976 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9spz\" (UniqueName: \"kubernetes.io/projected/03bc1185-05d2-495d-9355-12a5828312fd-kube-api-access-r9spz\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.426005 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-console-config\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426680 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.426655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-service-ca\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426876 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.426763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-console-config\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.426876 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.426765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-oauth-serving-cert\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.427025 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.426854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-trusted-ca-bundle\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.428392 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.428368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-serving-cert\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.428472 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.428389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-oauth-config\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.434737 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.434714 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9spz\" (UniqueName: \"kubernetes.io/projected/03bc1185-05d2-495d-9355-12a5828312fd-kube-api-access-r9spz\") pod \"console-f8f8ff858-fb4fk\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.501825 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.501757 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:06.625258 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.625236 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8f8ff858-fb4fk"] May 28 18:30:06.627873 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:30:06.627839 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bc1185_05d2_495d_9355_12a5828312fd.slice/crio-24997866b8f8b9f5a1ac9eba5ce60bd84be159ca04717961712c09bc5904c005 WatchSource:0}: Error finding container 24997866b8f8b9f5a1ac9eba5ce60bd84be159ca04717961712c09bc5904c005: Status 404 returned error can't find the container with id 24997866b8f8b9f5a1ac9eba5ce60bd84be159ca04717961712c09bc5904c005 May 28 18:30:06.709315 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.709288 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8f8ff858-fb4fk" event={"ID":"03bc1185-05d2-495d-9355-12a5828312fd","Type":"ContainerStarted","Data":"51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5"} May 28 18:30:06.709420 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.709325 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8f8ff858-fb4fk" event={"ID":"03bc1185-05d2-495d-9355-12a5828312fd","Type":"ContainerStarted","Data":"24997866b8f8b9f5a1ac9eba5ce60bd84be159ca04717961712c09bc5904c005"} May 28 18:30:06.728993 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:06.728942 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f8f8ff858-fb4fk" podStartSLOduration=0.728928165 podStartE2EDuration="728.928165ms" podCreationTimestamp="2026-05-28 18:30:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:30:06.727455589 +0000 UTC m=+246.401591204" watchObservedRunningTime="2026-05-28 18:30:06.728928165 +0000 UTC m=+246.403063780" May 28 18:30:12.669060 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:12.669016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:30:12.671256 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:12.671236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f00a9ddf-54b4-4627-9009-1cdd4e57125d-metrics-certs\") pod \"network-metrics-daemon-zqnxr\" (UID: \"f00a9ddf-54b4-4627-9009-1cdd4e57125d\") " pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:30:12.834264 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:12.834234 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2t4h\"" May 28 18:30:12.842363 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:12.842345 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqnxr" May 28 18:30:12.973447 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:12.973371 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zqnxr"] May 28 18:30:12.977728 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:30:12.977696 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00a9ddf_54b4_4627_9009_1cdd4e57125d.slice/crio-db781eab862f2600ab51d88f268eeddf3c5f6fff698c22a5ac4825fa2f1f9e2f WatchSource:0}: Error finding container db781eab862f2600ab51d88f268eeddf3c5f6fff698c22a5ac4825fa2f1f9e2f: Status 404 returned error can't find the container with id db781eab862f2600ab51d88f268eeddf3c5f6fff698c22a5ac4825fa2f1f9e2f May 28 18:30:13.729476 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:13.729436 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqnxr" event={"ID":"f00a9ddf-54b4-4627-9009-1cdd4e57125d","Type":"ContainerStarted","Data":"db781eab862f2600ab51d88f268eeddf3c5f6fff698c22a5ac4825fa2f1f9e2f"} May 28 18:30:14.733330 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:14.733293 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqnxr" event={"ID":"f00a9ddf-54b4-4627-9009-1cdd4e57125d","Type":"ContainerStarted","Data":"8d83259c59b169aee83f48c8a8c1f0be254f94f272464377a57056517e7f0c8a"} May 28 18:30:14.733330 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:14.733330 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqnxr" event={"ID":"f00a9ddf-54b4-4627-9009-1cdd4e57125d","Type":"ContainerStarted","Data":"6e8b247760e374905e04438ceff9ad0a20215f96bf84ed8751515c55ebe932d3"} May 28 18:30:14.753730 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:14.753686 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zqnxr" podStartSLOduration=252.763285605 podStartE2EDuration="4m13.75367263s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:30:12.979367527 +0000 UTC m=+252.653503124" lastFinishedPulling="2026-05-28 18:30:13.969754547 +0000 UTC m=+253.643890149" observedRunningTime="2026-05-28 18:30:14.752330284 +0000 UTC m=+254.426465900" watchObservedRunningTime="2026-05-28 18:30:14.75367263 +0000 UTC m=+254.427808245" May 28 18:30:16.501912 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:16.501875 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:16.501912 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:16.501921 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:16.506515 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:16.506495 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:16.744517 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:16.744487 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:30:16.792884 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:16.792807 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8fc5469d-479mg"] May 28 18:30:41.813611 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:41.813574 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5d8fc5469d-479mg" podUID="259bf8b7-78e3-4472-a955-21d721d7c0fe" containerName="console" containerID="cri-o://b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0" gracePeriod=15 May 28 18:30:42.061949 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.061926 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d8fc5469d-479mg_259bf8b7-78e3-4472-a955-21d721d7c0fe/console/0.log" May 28 18:30:42.062056 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.061982 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:30:42.208559 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208516 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-oauth-config\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.208711 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208605 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5pbf\" (UniqueName: \"kubernetes.io/projected/259bf8b7-78e3-4472-a955-21d721d7c0fe-kube-api-access-s5pbf\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.208711 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208623 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-serving-cert\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.208711 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208644 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-oauth-serving-cert\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.208711 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208663 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-config\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.208711 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208693 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-trusted-ca-bundle\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.208711 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.208707 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-service-ca\") pod \"259bf8b7-78e3-4472-a955-21d721d7c0fe\" (UID: \"259bf8b7-78e3-4472-a955-21d721d7c0fe\") " May 28 18:30:42.209041 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.209013 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:42.209154 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.209103 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-config" (OuterVolumeSpecName: "console-config") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:42.209154 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.209114 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:42.209331 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.209158 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:30:42.210816 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.210792 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259bf8b7-78e3-4472-a955-21d721d7c0fe-kube-api-access-s5pbf" (OuterVolumeSpecName: "kube-api-access-s5pbf") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "kube-api-access-s5pbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:30:42.210816 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.210803 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:42.210935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.210886 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "259bf8b7-78e3-4472-a955-21d721d7c0fe" (UID: "259bf8b7-78e3-4472-a955-21d721d7c0fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:30:42.309550 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309517 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-oauth-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.309650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309565 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5pbf\" (UniqueName: \"kubernetes.io/projected/259bf8b7-78e3-4472-a955-21d721d7c0fe-kube-api-access-s5pbf\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.309650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309575 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.309650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309584 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-oauth-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.309650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309595 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-console-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.309650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309604 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-trusted-ca-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.309650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.309612 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/259bf8b7-78e3-4472-a955-21d721d7c0fe-service-ca\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:30:42.814669 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.814641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d8fc5469d-479mg_259bf8b7-78e3-4472-a955-21d721d7c0fe/console/0.log" May 28 18:30:42.815016 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.814679 2559 generic.go:358] "Generic (PLEG): container finished" podID="259bf8b7-78e3-4472-a955-21d721d7c0fe" containerID="b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0" exitCode=2 May 28 18:30:42.815016 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.814754 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8fc5469d-479mg" May 28 18:30:42.815016 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.814772 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8fc5469d-479mg" event={"ID":"259bf8b7-78e3-4472-a955-21d721d7c0fe","Type":"ContainerDied","Data":"b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0"} May 28 18:30:42.815016 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.814814 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8fc5469d-479mg" event={"ID":"259bf8b7-78e3-4472-a955-21d721d7c0fe","Type":"ContainerDied","Data":"83c4ece1570c10b6444e80115b4ed153b820d4f72eb123fa229ba298de1aa68b"} May 28 18:30:42.815016 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.814831 2559 scope.go:117] "RemoveContainer" containerID="b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0" May 28 18:30:42.825005 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.824972 2559 scope.go:117] "RemoveContainer" containerID="b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0" May 28 18:30:42.825337 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:30:42.825309 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0\": container with ID starting with b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0 not found: ID does not exist" containerID="b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0" May 28 18:30:42.825434 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.825340 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0"} err="failed to get container status \"b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0\": rpc error: code = NotFound desc = could not find container \"b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0\": container with ID starting with b0460b265346e3974d07e2fee838e9e074ccc33f8710e067a3536bf96f3e5fc0 not found: ID does not exist" May 28 18:30:42.836142 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.836113 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8fc5469d-479mg"] May 28 18:30:42.840528 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.840504 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d8fc5469d-479mg"] May 28 18:30:42.933528 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:30:42.933487 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="259bf8b7-78e3-4472-a955-21d721d7c0fe" path="/var/lib/kubelet/pods/259bf8b7-78e3-4472-a955-21d721d7c0fe/volumes" May 28 18:31:00.811766 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:00.811730 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:31:00.812239 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:00.811868 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:31:00.820775 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:00.820754 2559 kubelet.go:1628] "Image garbage collection succeeded" May 28 18:31:44.181801 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.181753 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfccb67cd-zgm9k"] May 28 18:31:44.182199 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.182068 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259bf8b7-78e3-4472-a955-21d721d7c0fe" containerName="console" May 28 18:31:44.182199 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.182083 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="259bf8b7-78e3-4472-a955-21d721d7c0fe" containerName="console" May 28 18:31:44.182199 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.182135 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="259bf8b7-78e3-4472-a955-21d721d7c0fe" containerName="console" May 28 18:31:44.184065 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.184044 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.196756 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.196735 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfccb67cd-zgm9k"] May 28 18:31:44.270673 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-config\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.270812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjc4f\" (UniqueName: \"kubernetes.io/projected/b81e3eef-e755-4c97-a7ec-572bd2f1e990-kube-api-access-cjc4f\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.270812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-serving-cert\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.270812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-oauth-config\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.270935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-service-ca\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.270935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-oauth-serving-cert\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.271008 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.270940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-trusted-ca-bundle\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372032 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-service-ca\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372088 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-oauth-serving-cert\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372120 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-trusted-ca-bundle\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372148 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-config\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372178 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjc4f\" (UniqueName: \"kubernetes.io/projected/b81e3eef-e755-4c97-a7ec-572bd2f1e990-kube-api-access-cjc4f\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372211 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-serving-cert\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372464 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-oauth-config\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372855 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-service-ca\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.372982 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-oauth-serving-cert\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.373049 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.372978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-config\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.373101 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.373058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-trusted-ca-bundle\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.374815 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.374792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-oauth-config\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.374895 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.374830 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-serving-cert\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.381016 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.380995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjc4f\" (UniqueName: \"kubernetes.io/projected/b81e3eef-e755-4c97-a7ec-572bd2f1e990-kube-api-access-cjc4f\") pod \"console-5dfccb67cd-zgm9k\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.494176 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.494115 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:44.614758 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.614708 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfccb67cd-zgm9k"] May 28 18:31:44.617373 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:31:44.617344 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81e3eef_e755_4c97_a7ec_572bd2f1e990.slice/crio-d57d100b6f5a13d5fb8e839834b22d25526e5fda12c8dfff199fb43f03bf62ba WatchSource:0}: Error finding container d57d100b6f5a13d5fb8e839834b22d25526e5fda12c8dfff199fb43f03bf62ba: Status 404 returned error can't find the container with id d57d100b6f5a13d5fb8e839834b22d25526e5fda12c8dfff199fb43f03bf62ba May 28 18:31:44.619169 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.619149 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:31:44.995684 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.995639 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfccb67cd-zgm9k" event={"ID":"b81e3eef-e755-4c97-a7ec-572bd2f1e990","Type":"ContainerStarted","Data":"f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd"} May 28 18:31:44.995684 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:44.995682 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfccb67cd-zgm9k" event={"ID":"b81e3eef-e755-4c97-a7ec-572bd2f1e990","Type":"ContainerStarted","Data":"d57d100b6f5a13d5fb8e839834b22d25526e5fda12c8dfff199fb43f03bf62ba"} May 28 18:31:45.014304 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:45.014263 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5dfccb67cd-zgm9k" podStartSLOduration=1.014250952 podStartE2EDuration="1.014250952s" podCreationTimestamp="2026-05-28 18:31:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:31:45.013319535 +0000 UTC m=+344.687455153" watchObservedRunningTime="2026-05-28 18:31:45.014250952 +0000 UTC m=+344.688386566" May 28 18:31:54.495295 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:54.495201 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:54.495295 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:54.495247 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:54.499808 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:54.499784 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:55.026603 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:55.026575 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:31:55.076486 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:31:55.076453 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8f8ff858-fb4fk"] May 28 18:32:20.099339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.099282 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f8f8ff858-fb4fk" podUID="03bc1185-05d2-495d-9355-12a5828312fd" containerName="console" containerID="cri-o://51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5" gracePeriod=15 May 28 18:32:20.336505 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.336484 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f8f8ff858-fb4fk_03bc1185-05d2-495d-9355-12a5828312fd/console/0.log" May 28 18:32:20.336649 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.336562 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:32:20.449783 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.449753 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-trusted-ca-bundle\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.449783 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.449782 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-oauth-serving-cert\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.449972 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.449815 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-serving-cert\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.449972 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.449844 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-service-ca\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.449972 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.449898 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9spz\" (UniqueName: \"kubernetes.io/projected/03bc1185-05d2-495d-9355-12a5828312fd-kube-api-access-r9spz\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.450127 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450107 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-console-config\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.450186 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450156 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-oauth-config\") pod \"03bc1185-05d2-495d-9355-12a5828312fd\" (UID: \"03bc1185-05d2-495d-9355-12a5828312fd\") " May 28 18:32:20.450264 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450236 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:32:20.450315 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450258 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:32:20.450315 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450269 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:32:20.450467 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450450 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-trusted-ca-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:20.450532 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450472 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-oauth-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:20.450532 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450465 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-console-config" (OuterVolumeSpecName: "console-config") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:32:20.450532 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.450488 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-service-ca\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:20.452068 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.452049 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:32:20.452148 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.452120 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:32:20.452200 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.452183 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03bc1185-05d2-495d-9355-12a5828312fd-kube-api-access-r9spz" (OuterVolumeSpecName: "kube-api-access-r9spz") pod "03bc1185-05d2-495d-9355-12a5828312fd" (UID: "03bc1185-05d2-495d-9355-12a5828312fd"). InnerVolumeSpecName "kube-api-access-r9spz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:32:20.551286 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.551262 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:20.551286 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.551282 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9spz\" (UniqueName: \"kubernetes.io/projected/03bc1185-05d2-495d-9355-12a5828312fd-kube-api-access-r9spz\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:20.551409 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.551292 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03bc1185-05d2-495d-9355-12a5828312fd-console-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:20.551409 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:20.551302 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03bc1185-05d2-495d-9355-12a5828312fd-console-oauth-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:21.096915 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.096885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f8f8ff858-fb4fk_03bc1185-05d2-495d-9355-12a5828312fd/console/0.log" May 28 18:32:21.097094 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.096929 2559 generic.go:358] "Generic (PLEG): container finished" podID="03bc1185-05d2-495d-9355-12a5828312fd" containerID="51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5" exitCode=2 May 28 18:32:21.097094 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.096972 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8f8ff858-fb4fk" event={"ID":"03bc1185-05d2-495d-9355-12a5828312fd","Type":"ContainerDied","Data":"51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5"} May 28 18:32:21.097094 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.096993 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8f8ff858-fb4fk" May 28 18:32:21.097094 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.097011 2559 scope.go:117] "RemoveContainer" containerID="51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5" May 28 18:32:21.097094 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.096999 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8f8ff858-fb4fk" event={"ID":"03bc1185-05d2-495d-9355-12a5828312fd","Type":"ContainerDied","Data":"24997866b8f8b9f5a1ac9eba5ce60bd84be159ca04717961712c09bc5904c005"} May 28 18:32:21.104716 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.104555 2559 scope.go:117] "RemoveContainer" containerID="51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5" May 28 18:32:21.104930 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:32:21.104786 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5\": container with ID starting with 51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5 not found: ID does not exist" containerID="51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5" May 28 18:32:21.104930 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.104811 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5"} err="failed to get container status \"51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5\": rpc error: code = NotFound desc = could not find container \"51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5\": container with ID starting with 51299e70a7370b6c27ac4b0d497c4eeeb4afa370af18c80e9f129f8833f77cd5 not found: ID does not exist" May 28 18:32:21.132659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.132635 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8f8ff858-fb4fk"] May 28 18:32:21.143203 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:21.143182 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f8f8ff858-fb4fk"] May 28 18:32:22.200361 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.200328 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg"] May 28 18:32:22.200820 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.200785 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03bc1185-05d2-495d-9355-12a5828312fd" containerName="console" May 28 18:32:22.200820 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.200803 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03bc1185-05d2-495d-9355-12a5828312fd" containerName="console" May 28 18:32:22.200934 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.200874 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="03bc1185-05d2-495d-9355-12a5828312fd" containerName="console" May 28 18:32:22.203873 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.203853 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.206768 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.206749 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rpf5z\"" May 28 18:32:22.207372 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.207353 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 28 18:32:22.207483 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.207384 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 28 18:32:22.218388 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.218369 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg"] May 28 18:32:22.262299 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.262273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzwzx\" (UniqueName: \"kubernetes.io/projected/28f373fd-55a6-4357-abe9-f678f5c66718-kube-api-access-jzwzx\") pod \"cert-manager-operator-controller-manager-54b9655956-rgxqg\" (UID: \"28f373fd-55a6-4357-abe9-f678f5c66718\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.262421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.262338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f373fd-55a6-4357-abe9-f678f5c66718-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-rgxqg\" (UID: \"28f373fd-55a6-4357-abe9-f678f5c66718\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.362825 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.362800 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f373fd-55a6-4357-abe9-f678f5c66718-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-rgxqg\" (UID: \"28f373fd-55a6-4357-abe9-f678f5c66718\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.362956 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.362840 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzwzx\" (UniqueName: \"kubernetes.io/projected/28f373fd-55a6-4357-abe9-f678f5c66718-kube-api-access-jzwzx\") pod \"cert-manager-operator-controller-manager-54b9655956-rgxqg\" (UID: \"28f373fd-55a6-4357-abe9-f678f5c66718\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.363215 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.363194 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f373fd-55a6-4357-abe9-f678f5c66718-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-rgxqg\" (UID: \"28f373fd-55a6-4357-abe9-f678f5c66718\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.372943 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.372917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzwzx\" (UniqueName: \"kubernetes.io/projected/28f373fd-55a6-4357-abe9-f678f5c66718-kube-api-access-jzwzx\") pod \"cert-manager-operator-controller-manager-54b9655956-rgxqg\" (UID: \"28f373fd-55a6-4357-abe9-f678f5c66718\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.512589 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.512509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" May 28 18:32:22.645788 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.645728 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg"] May 28 18:32:22.650844 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:32:22.650817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f373fd_55a6_4357_abe9_f678f5c66718.slice/crio-c7bc8c795b4d3ec34102d9102e91d09f7068970731fd2464252db05f8d239bc6 WatchSource:0}: Error finding container c7bc8c795b4d3ec34102d9102e91d09f7068970731fd2464252db05f8d239bc6: Status 404 returned error can't find the container with id c7bc8c795b4d3ec34102d9102e91d09f7068970731fd2464252db05f8d239bc6 May 28 18:32:22.933455 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:22.933424 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03bc1185-05d2-495d-9355-12a5828312fd" path="/var/lib/kubelet/pods/03bc1185-05d2-495d-9355-12a5828312fd/volumes" May 28 18:32:23.105838 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:23.105806 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" event={"ID":"28f373fd-55a6-4357-abe9-f678f5c66718","Type":"ContainerStarted","Data":"c7bc8c795b4d3ec34102d9102e91d09f7068970731fd2464252db05f8d239bc6"} May 28 18:32:26.117381 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.117346 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" event={"ID":"28f373fd-55a6-4357-abe9-f678f5c66718","Type":"ContainerStarted","Data":"b6797ee9fd1d5fe4b0361828312d070e2d452fc79237094e09ec6ef83f0fde35"} May 28 18:32:26.141285 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.141234 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rgxqg" podStartSLOduration=1.444180814 podStartE2EDuration="4.1412178s" podCreationTimestamp="2026-05-28 18:32:22 +0000 UTC" firstStartedPulling="2026-05-28 18:32:22.654750838 +0000 UTC m=+382.328886434" lastFinishedPulling="2026-05-28 18:32:25.351787812 +0000 UTC m=+385.025923420" observedRunningTime="2026-05-28 18:32:26.138208572 +0000 UTC m=+385.812344208" watchObservedRunningTime="2026-05-28 18:32:26.1412178 +0000 UTC m=+385.815353415" May 28 18:32:26.777892 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.777848 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb"] May 28 18:32:26.781446 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.781430 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.783975 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.783957 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 28 18:32:26.785032 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.785009 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqr58\"" May 28 18:32:26.785119 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.785010 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 28 18:32:26.790569 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.790531 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb"] May 28 18:32:26.797646 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.797625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vh6\" (UniqueName: \"kubernetes.io/projected/b1719f91-c888-4f3e-a3cf-402b752f2cef-kube-api-access-r9vh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.797740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.797654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.797740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.797677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.898527 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.898496 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vh6\" (UniqueName: \"kubernetes.io/projected/b1719f91-c888-4f3e-a3cf-402b752f2cef-kube-api-access-r9vh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.898697 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.898532 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.898697 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.898581 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.898920 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.898902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.899000 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.898981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:26.908679 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:26.908649 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vh6\" (UniqueName: \"kubernetes.io/projected/b1719f91-c888-4f3e-a3cf-402b752f2cef-kube-api-access-r9vh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:27.091114 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:27.091028 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:27.221755 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:27.221458 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb"] May 28 18:32:28.125740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:28.125704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" event={"ID":"b1719f91-c888-4f3e-a3cf-402b752f2cef","Type":"ContainerStarted","Data":"8f9acb7fe36459e7b320835bb6975b9c65d8b40b1d4f866355b31da86afc5345"} May 28 18:32:34.147636 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:34.147601 2559 generic.go:358] "Generic (PLEG): container finished" podID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerID="f0de0339e0742dbc6329f03f306b7a4772f80edbb18b238c8a4d2ea8bf9f66f5" exitCode=0 May 28 18:32:34.147636 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:34.147641 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" event={"ID":"b1719f91-c888-4f3e-a3cf-402b752f2cef","Type":"ContainerDied","Data":"f0de0339e0742dbc6329f03f306b7a4772f80edbb18b238c8a4d2ea8bf9f66f5"} May 28 18:32:36.155441 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:36.155414 2559 generic.go:358] "Generic (PLEG): container finished" podID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerID="2b411c39469ab3ab0a6359b718baafd31761816c6d74f594e4254e0b6e73d68d" exitCode=0 May 28 18:32:36.155761 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:36.155498 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" event={"ID":"b1719f91-c888-4f3e-a3cf-402b752f2cef","Type":"ContainerDied","Data":"2b411c39469ab3ab0a6359b718baafd31761816c6d74f594e4254e0b6e73d68d"} May 28 18:32:41.096021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.095986 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-b6z62"] May 28 18:32:41.113353 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.113292 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-b6z62"] May 28 18:32:41.113519 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.113418 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.116673 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.116647 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 28 18:32:41.116992 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.116914 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8tf9v\"" May 28 18:32:41.117803 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.117773 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 28 18:32:41.197490 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.197455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7407076a-ebc0-43e7-b83c-1fb51f69fac1-bound-sa-token\") pod \"cert-manager-79c8d999ff-b6z62\" (UID: \"7407076a-ebc0-43e7-b83c-1fb51f69fac1\") " pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.197669 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.197496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqd82\" (UniqueName: \"kubernetes.io/projected/7407076a-ebc0-43e7-b83c-1fb51f69fac1-kube-api-access-mqd82\") pod \"cert-manager-79c8d999ff-b6z62\" (UID: \"7407076a-ebc0-43e7-b83c-1fb51f69fac1\") " pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.298182 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.298141 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7407076a-ebc0-43e7-b83c-1fb51f69fac1-bound-sa-token\") pod \"cert-manager-79c8d999ff-b6z62\" (UID: \"7407076a-ebc0-43e7-b83c-1fb51f69fac1\") " pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.298358 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.298199 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqd82\" (UniqueName: \"kubernetes.io/projected/7407076a-ebc0-43e7-b83c-1fb51f69fac1-kube-api-access-mqd82\") pod \"cert-manager-79c8d999ff-b6z62\" (UID: \"7407076a-ebc0-43e7-b83c-1fb51f69fac1\") " pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.306917 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.306893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7407076a-ebc0-43e7-b83c-1fb51f69fac1-bound-sa-token\") pod \"cert-manager-79c8d999ff-b6z62\" (UID: \"7407076a-ebc0-43e7-b83c-1fb51f69fac1\") " pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.307053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.307037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqd82\" (UniqueName: \"kubernetes.io/projected/7407076a-ebc0-43e7-b83c-1fb51f69fac1-kube-api-access-mqd82\") pod \"cert-manager-79c8d999ff-b6z62\" (UID: \"7407076a-ebc0-43e7-b83c-1fb51f69fac1\") " pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:41.436742 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:41.436709 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-b6z62" May 28 18:32:42.766114 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:42.766002 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-b6z62"] May 28 18:32:42.768615 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:32:42.768581 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7407076a_ebc0_43e7_b83c_1fb51f69fac1.slice/crio-0862b36a75d7bc24cdb4650c3889fe6a59c73311ab82dd528cf8d09cbfd17e1d WatchSource:0}: Error finding container 0862b36a75d7bc24cdb4650c3889fe6a59c73311ab82dd528cf8d09cbfd17e1d: Status 404 returned error can't find the container with id 0862b36a75d7bc24cdb4650c3889fe6a59c73311ab82dd528cf8d09cbfd17e1d May 28 18:32:43.180593 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:43.180551 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-b6z62" event={"ID":"7407076a-ebc0-43e7-b83c-1fb51f69fac1","Type":"ContainerStarted","Data":"0862b36a75d7bc24cdb4650c3889fe6a59c73311ab82dd528cf8d09cbfd17e1d"} May 28 18:32:43.182485 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:43.182453 2559 generic.go:358] "Generic (PLEG): container finished" podID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerID="86b69556d743ab4a2ce9a97e00bf33eeda956e0b031d6b84e952e40bda836d2c" exitCode=0 May 28 18:32:43.182760 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:43.182486 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" event={"ID":"b1719f91-c888-4f3e-a3cf-402b752f2cef","Type":"ContainerDied","Data":"86b69556d743ab4a2ce9a97e00bf33eeda956e0b031d6b84e952e40bda836d2c"} May 28 18:32:44.323190 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.323162 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:44.422360 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.422327 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9vh6\" (UniqueName: \"kubernetes.io/projected/b1719f91-c888-4f3e-a3cf-402b752f2cef-kube-api-access-r9vh6\") pod \"b1719f91-c888-4f3e-a3cf-402b752f2cef\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " May 28 18:32:44.422499 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.422388 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-bundle\") pod \"b1719f91-c888-4f3e-a3cf-402b752f2cef\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " May 28 18:32:44.422499 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.422477 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-util\") pod \"b1719f91-c888-4f3e-a3cf-402b752f2cef\" (UID: \"b1719f91-c888-4f3e-a3cf-402b752f2cef\") " May 28 18:32:44.422862 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.422833 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-bundle" (OuterVolumeSpecName: "bundle") pod "b1719f91-c888-4f3e-a3cf-402b752f2cef" (UID: "b1719f91-c888-4f3e-a3cf-402b752f2cef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:32:44.424823 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.424798 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1719f91-c888-4f3e-a3cf-402b752f2cef-kube-api-access-r9vh6" (OuterVolumeSpecName: "kube-api-access-r9vh6") pod "b1719f91-c888-4f3e-a3cf-402b752f2cef" (UID: "b1719f91-c888-4f3e-a3cf-402b752f2cef"). InnerVolumeSpecName "kube-api-access-r9vh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:32:44.428398 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.428373 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-util" (OuterVolumeSpecName: "util") pod "b1719f91-c888-4f3e-a3cf-402b752f2cef" (UID: "b1719f91-c888-4f3e-a3cf-402b752f2cef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:32:44.523269 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.523198 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-util\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:44.523269 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.523225 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9vh6\" (UniqueName: \"kubernetes.io/projected/b1719f91-c888-4f3e-a3cf-402b752f2cef-kube-api-access-r9vh6\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:44.523269 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:44.523236 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1719f91-c888-4f3e-a3cf-402b752f2cef-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:32:45.191050 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:45.191010 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" event={"ID":"b1719f91-c888-4f3e-a3cf-402b752f2cef","Type":"ContainerDied","Data":"8f9acb7fe36459e7b320835bb6975b9c65d8b40b1d4f866355b31da86afc5345"} May 28 18:32:45.191050 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:45.191044 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f9acb7fe36459e7b320835bb6975b9c65d8b40b1d4f866355b31da86afc5345" May 28 18:32:45.191250 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:45.191070 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv5nb" May 28 18:32:46.195092 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:46.195058 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-b6z62" event={"ID":"7407076a-ebc0-43e7-b83c-1fb51f69fac1","Type":"ContainerStarted","Data":"9e6375f51ad46e9612ea07b65fd0be01751395cb0c067f7bea3f50f9936956b9"} May 28 18:32:46.211980 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:46.211930 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-b6z62" podStartSLOduration=2.394773914 podStartE2EDuration="5.211918141s" podCreationTimestamp="2026-05-28 18:32:41 +0000 UTC" firstStartedPulling="2026-05-28 18:32:42.770996006 +0000 UTC m=+402.445131605" lastFinishedPulling="2026-05-28 18:32:45.588140235 +0000 UTC m=+405.262275832" observedRunningTime="2026-05-28 18:32:46.211021529 +0000 UTC m=+405.885157146" watchObservedRunningTime="2026-05-28 18:32:46.211918141 +0000 UTC m=+405.886053756" May 28 18:32:51.030937 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.030902 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75"] May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031224 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="extract" May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031236 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="extract" May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031252 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="pull" May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031257 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="pull" May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031265 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="util" May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031271 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="util" May 28 18:32:51.031339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.031324 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1719f91-c888-4f3e-a3cf-402b752f2cef" containerName="extract" May 28 18:32:51.058689 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.058645 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75"] May 28 18:32:51.058848 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.058781 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.061666 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.061643 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 18:32:51.061666 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.061659 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 18:32:51.061819 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.061734 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r8276\"" May 28 18:32:51.074256 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.074235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlw2\" (UniqueName: \"kubernetes.io/projected/400d1f21-a7cc-4827-8507-e3ecff934c17-kube-api-access-4xlw2\") pod \"openshift-lws-operator-bfc7f696d-chl75\" (UID: \"400d1f21-a7cc-4827-8507-e3ecff934c17\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.074331 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.074278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400d1f21-a7cc-4827-8507-e3ecff934c17-tmp\") pod \"openshift-lws-operator-bfc7f696d-chl75\" (UID: \"400d1f21-a7cc-4827-8507-e3ecff934c17\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.175174 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.175150 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlw2\" (UniqueName: \"kubernetes.io/projected/400d1f21-a7cc-4827-8507-e3ecff934c17-kube-api-access-4xlw2\") pod \"openshift-lws-operator-bfc7f696d-chl75\" (UID: \"400d1f21-a7cc-4827-8507-e3ecff934c17\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.175296 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.175193 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400d1f21-a7cc-4827-8507-e3ecff934c17-tmp\") pod \"openshift-lws-operator-bfc7f696d-chl75\" (UID: \"400d1f21-a7cc-4827-8507-e3ecff934c17\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.175489 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.175473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400d1f21-a7cc-4827-8507-e3ecff934c17-tmp\") pod \"openshift-lws-operator-bfc7f696d-chl75\" (UID: \"400d1f21-a7cc-4827-8507-e3ecff934c17\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.187949 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.187926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlw2\" (UniqueName: \"kubernetes.io/projected/400d1f21-a7cc-4827-8507-e3ecff934c17-kube-api-access-4xlw2\") pod \"openshift-lws-operator-bfc7f696d-chl75\" (UID: \"400d1f21-a7cc-4827-8507-e3ecff934c17\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.368270 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.368186 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" May 28 18:32:51.500593 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:51.500530 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75"] May 28 18:32:51.503287 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:32:51.503258 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod400d1f21_a7cc_4827_8507_e3ecff934c17.slice/crio-2e5e8bda8050e7a2281556ece3f06a0e5670dc468a241fdf7550bb21d4a1acf7 WatchSource:0}: Error finding container 2e5e8bda8050e7a2281556ece3f06a0e5670dc468a241fdf7550bb21d4a1acf7: Status 404 returned error can't find the container with id 2e5e8bda8050e7a2281556ece3f06a0e5670dc468a241fdf7550bb21d4a1acf7 May 28 18:32:52.213808 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:52.213775 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" event={"ID":"400d1f21-a7cc-4827-8507-e3ecff934c17","Type":"ContainerStarted","Data":"2e5e8bda8050e7a2281556ece3f06a0e5670dc468a241fdf7550bb21d4a1acf7"} May 28 18:32:54.221803 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:54.221767 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" event={"ID":"400d1f21-a7cc-4827-8507-e3ecff934c17","Type":"ContainerStarted","Data":"868855f77c0c2388186c3197549603f9d3f689749f5039793b9f7f37fdc739b2"} May 28 18:32:54.236883 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:32:54.236833 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-chl75" podStartSLOduration=1.44616419 podStartE2EDuration="3.236818663s" podCreationTimestamp="2026-05-28 18:32:51 +0000 UTC" firstStartedPulling="2026-05-28 18:32:51.504863847 +0000 UTC m=+411.178999445" lastFinishedPulling="2026-05-28 18:32:53.295518312 +0000 UTC m=+412.969653918" observedRunningTime="2026-05-28 18:32:54.235839267 +0000 UTC m=+413.909974883" watchObservedRunningTime="2026-05-28 18:32:54.236818663 +0000 UTC m=+413.910954278" May 28 18:33:09.190884 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.190852 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk"] May 28 18:33:09.193945 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.193928 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.197685 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.197661 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 18:33:09.197685 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.197679 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 18:33:09.197868 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.197805 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 18:33:09.198508 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.198456 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 18:33:09.198831 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.198814 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l9hnf\"" May 28 18:33:09.214638 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.214615 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk"] May 28 18:33:09.329816 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.329785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e98f487-70c5-45f4-9535-b123f8a0f505-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.329816 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.329816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e98f487-70c5-45f4-9535-b123f8a0f505-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.329991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.329860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxht\" (UniqueName: \"kubernetes.io/projected/2e98f487-70c5-45f4-9535-b123f8a0f505-kube-api-access-4vxht\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.430578 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.430532 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e98f487-70c5-45f4-9535-b123f8a0f505-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.430578 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.430578 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e98f487-70c5-45f4-9535-b123f8a0f505-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.430752 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.430612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxht\" (UniqueName: \"kubernetes.io/projected/2e98f487-70c5-45f4-9535-b123f8a0f505-kube-api-access-4vxht\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.433232 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.433208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e98f487-70c5-45f4-9535-b123f8a0f505-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.433302 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.433208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e98f487-70c5-45f4-9535-b123f8a0f505-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.438259 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.438233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxht\" (UniqueName: \"kubernetes.io/projected/2e98f487-70c5-45f4-9535-b123f8a0f505-kube-api-access-4vxht\") pod \"opendatahub-operator-controller-manager-67686c6958-nbcmk\" (UID: \"2e98f487-70c5-45f4-9535-b123f8a0f505\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.504447 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.504390 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:09.632440 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:09.632417 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk"] May 28 18:33:09.634797 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:33:09.634757 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e98f487_70c5_45f4_9535_b123f8a0f505.slice/crio-0808954a3b07fc175c2d30a5b87702ff655f177d933db6b4bf7d769a91cb78dc WatchSource:0}: Error finding container 0808954a3b07fc175c2d30a5b87702ff655f177d933db6b4bf7d769a91cb78dc: Status 404 returned error can't find the container with id 0808954a3b07fc175c2d30a5b87702ff655f177d933db6b4bf7d769a91cb78dc May 28 18:33:10.273267 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:10.273232 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" event={"ID":"2e98f487-70c5-45f4-9535-b123f8a0f505","Type":"ContainerStarted","Data":"0808954a3b07fc175c2d30a5b87702ff655f177d933db6b4bf7d769a91cb78dc"} May 28 18:33:12.282880 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:12.282785 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" event={"ID":"2e98f487-70c5-45f4-9535-b123f8a0f505","Type":"ContainerStarted","Data":"9fd71ba48b861074045835c38c13d7b5f1660f47830e409dc1528429895a0217"} May 28 18:33:12.282880 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:12.282851 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:12.306887 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:12.306841 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" podStartSLOduration=0.96310499 podStartE2EDuration="3.306801188s" podCreationTimestamp="2026-05-28 18:33:09 +0000 UTC" firstStartedPulling="2026-05-28 18:33:09.636382944 +0000 UTC m=+429.310518540" lastFinishedPulling="2026-05-28 18:33:11.980079142 +0000 UTC m=+431.654214738" observedRunningTime="2026-05-28 18:33:12.305530917 +0000 UTC m=+431.979666531" watchObservedRunningTime="2026-05-28 18:33:12.306801188 +0000 UTC m=+431.980936801" May 28 18:33:22.106431 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.106361 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln"] May 28 18:33:22.108705 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.108689 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.113222 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.113202 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 18:33:22.113222 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.113223 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wnqwj\"" May 28 18:33:22.113405 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.113227 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 18:33:22.113405 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.113227 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 18:33:22.124238 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.124218 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln"] May 28 18:33:22.238001 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.237974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0454c11-71e6-4d64-b2d0-3005df3002c1-metrics-cert\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.238001 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.238004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0454c11-71e6-4d64-b2d0-3005df3002c1-manager-config\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.238175 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.238035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqjmj\" (UniqueName: \"kubernetes.io/projected/a0454c11-71e6-4d64-b2d0-3005df3002c1-kube-api-access-jqjmj\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.238175 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.238099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0454c11-71e6-4d64-b2d0-3005df3002c1-cert\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.339265 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.339232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0454c11-71e6-4d64-b2d0-3005df3002c1-metrics-cert\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.339265 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.339263 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0454c11-71e6-4d64-b2d0-3005df3002c1-manager-config\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.339503 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.339295 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqjmj\" (UniqueName: \"kubernetes.io/projected/a0454c11-71e6-4d64-b2d0-3005df3002c1-kube-api-access-jqjmj\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.339503 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.339319 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0454c11-71e6-4d64-b2d0-3005df3002c1-cert\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.339877 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.339852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0454c11-71e6-4d64-b2d0-3005df3002c1-manager-config\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.341766 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.341746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0454c11-71e6-4d64-b2d0-3005df3002c1-metrics-cert\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.341845 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.341800 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0454c11-71e6-4d64-b2d0-3005df3002c1-cert\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.353853 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.353828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqjmj\" (UniqueName: \"kubernetes.io/projected/a0454c11-71e6-4d64-b2d0-3005df3002c1-kube-api-access-jqjmj\") pod \"lws-controller-manager-77d4cfb68f-5wgln\" (UID: \"a0454c11-71e6-4d64-b2d0-3005df3002c1\") " pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.418037 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.418007 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:22.539793 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:22.539769 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln"] May 28 18:33:22.542422 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:33:22.542398 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0454c11_71e6_4d64_b2d0_3005df3002c1.slice/crio-73e743eb5f21d3fbdec0b8b50f1dbb2d8f143271311b0f9df7b9edb95f865e28 WatchSource:0}: Error finding container 73e743eb5f21d3fbdec0b8b50f1dbb2d8f143271311b0f9df7b9edb95f865e28: Status 404 returned error can't find the container with id 73e743eb5f21d3fbdec0b8b50f1dbb2d8f143271311b0f9df7b9edb95f865e28 May 28 18:33:23.287667 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:23.287639 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-nbcmk" May 28 18:33:23.319786 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:23.319747 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" event={"ID":"a0454c11-71e6-4d64-b2d0-3005df3002c1","Type":"ContainerStarted","Data":"73e743eb5f21d3fbdec0b8b50f1dbb2d8f143271311b0f9df7b9edb95f865e28"} May 28 18:33:24.324656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:24.324621 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" event={"ID":"a0454c11-71e6-4d64-b2d0-3005df3002c1","Type":"ContainerStarted","Data":"e3169463de19ce4fd81dc4f7525c121be8736c1f36732a3267ab1848aa0d3b7e"} May 28 18:33:24.325007 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:24.324674 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:33:24.347572 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:24.344996 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" podStartSLOduration=0.680132162 podStartE2EDuration="2.344977281s" podCreationTimestamp="2026-05-28 18:33:22 +0000 UTC" firstStartedPulling="2026-05-28 18:33:22.544106056 +0000 UTC m=+442.218241649" lastFinishedPulling="2026-05-28 18:33:24.208951172 +0000 UTC m=+443.883086768" observedRunningTime="2026-05-28 18:33:24.341181937 +0000 UTC m=+444.015317551" watchObservedRunningTime="2026-05-28 18:33:24.344977281 +0000 UTC m=+444.019112898" May 28 18:33:35.330093 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:33:35.330065 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77d4cfb68f-5wgln" May 28 18:34:08.201765 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.201726 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k"] May 28 18:34:08.204436 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.204415 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.207260 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.207239 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 18:34:08.207260 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.207254 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2s598\"" May 28 18:34:08.217670 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.217646 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k"] May 28 18:34:08.298885 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.298853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.298895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.298942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.298980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.299015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.299034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zp4s\" (UniqueName: \"kubernetes.io/projected/839b5acb-58f7-4d0a-be95-ee3031f72b5d-kube-api-access-9zp4s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299196 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.299081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299196 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.299115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.299196 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.299137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400468 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400438 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400484 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400514 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400555 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400614 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400584 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400627 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400655 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zp4s\" (UniqueName: \"kubernetes.io/projected/839b5acb-58f7-4d0a-be95-ee3031f72b5d-kube-api-access-9zp4s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400685 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.400812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.401007 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.400972 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.401090 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.401065 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.401157 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.401122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.401329 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.401311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.401391 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.401343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.402805 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.402783 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.403053 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.403035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.408383 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.408356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839b5acb-58f7-4d0a-be95-ee3031f72b5d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.408697 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.408681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zp4s\" (UniqueName: \"kubernetes.io/projected/839b5acb-58f7-4d0a-be95-ee3031f72b5d-kube-api-access-9zp4s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb222k\" (UID: \"839b5acb-58f7-4d0a-be95-ee3031f72b5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.518014 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.517933 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:08.647527 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:08.647496 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k"] May 28 18:34:08.650058 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:08.650034 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839b5acb_58f7_4d0a_be95_ee3031f72b5d.slice/crio-44197a94cc2567dde34df49535925e00473ee87e711f24ba229dab6314c619ab WatchSource:0}: Error finding container 44197a94cc2567dde34df49535925e00473ee87e711f24ba229dab6314c619ab: Status 404 returned error can't find the container with id 44197a94cc2567dde34df49535925e00473ee87e711f24ba229dab6314c619ab May 28 18:34:09.473436 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:09.473394 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" event={"ID":"839b5acb-58f7-4d0a-be95-ee3031f72b5d","Type":"ContainerStarted","Data":"44197a94cc2567dde34df49535925e00473ee87e711f24ba229dab6314c619ab"} May 28 18:34:11.100260 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:11.100222 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 18:34:11.100511 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:11.100299 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 18:34:11.100511 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:11.100327 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 18:34:11.480770 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:11.480732 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" event={"ID":"839b5acb-58f7-4d0a-be95-ee3031f72b5d","Type":"ContainerStarted","Data":"5fb9f664bdb31a06d58aea0afb661fcfaee0cba7eb55df9fd00c5d5d40e3d750"} May 28 18:34:11.502802 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:11.502743 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" podStartSLOduration=1.054618484 podStartE2EDuration="3.502725846s" podCreationTimestamp="2026-05-28 18:34:08 +0000 UTC" firstStartedPulling="2026-05-28 18:34:08.651886689 +0000 UTC m=+488.326022282" lastFinishedPulling="2026-05-28 18:34:11.099994049 +0000 UTC m=+490.774129644" observedRunningTime="2026-05-28 18:34:11.50085291 +0000 UTC m=+491.174988542" watchObservedRunningTime="2026-05-28 18:34:11.502725846 +0000 UTC m=+491.176861463" May 28 18:34:11.518201 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:11.518181 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:12.522870 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:12.522842 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:13.487121 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:13.487085 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:13.488134 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:13.488114 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb222k" May 28 18:34:26.929191 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:26.929157 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7h47"] May 28 18:34:26.932864 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:26.932835 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:26.935571 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:26.935532 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 18:34:26.936650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:26.936629 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 18:34:26.936763 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:26.936649 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fm2z5\"" May 28 18:34:26.944210 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:26.944174 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7h47"] May 28 18:34:27.055052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.055012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbggj\" (UniqueName: \"kubernetes.io/projected/b33c85b5-90be-4bcc-9262-744373067e35-kube-api-access-fbggj\") pod \"kuadrant-operator-catalog-g7h47\" (UID: \"b33c85b5-90be-4bcc-9262-744373067e35\") " pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:27.156300 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.156250 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbggj\" (UniqueName: \"kubernetes.io/projected/b33c85b5-90be-4bcc-9262-744373067e35-kube-api-access-fbggj\") pod \"kuadrant-operator-catalog-g7h47\" (UID: \"b33c85b5-90be-4bcc-9262-744373067e35\") " pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:27.167971 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.167939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbggj\" (UniqueName: \"kubernetes.io/projected/b33c85b5-90be-4bcc-9262-744373067e35-kube-api-access-fbggj\") pod \"kuadrant-operator-catalog-g7h47\" (UID: \"b33c85b5-90be-4bcc-9262-744373067e35\") " pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:27.244905 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.244828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:27.294108 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.294076 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7h47"] May 28 18:34:27.376273 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.376252 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7h47"] May 28 18:34:27.378653 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:27.378623 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33c85b5_90be_4bcc_9262_744373067e35.slice/crio-c0272b607bd094467bdf44273e748c72509d82284cd9cb4f88b3d89c85f5e6c1 WatchSource:0}: Error finding container c0272b607bd094467bdf44273e748c72509d82284cd9cb4f88b3d89c85f5e6c1: Status 404 returned error can't find the container with id c0272b607bd094467bdf44273e748c72509d82284cd9cb4f88b3d89c85f5e6c1 May 28 18:34:27.506422 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.506348 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-554cn"] May 28 18:34:27.510373 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.510356 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:27.519740 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.519709 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-554cn"] May 28 18:34:27.536507 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.536472 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" event={"ID":"b33c85b5-90be-4bcc-9262-744373067e35","Type":"ContainerStarted","Data":"c0272b607bd094467bdf44273e748c72509d82284cd9cb4f88b3d89c85f5e6c1"} May 28 18:34:27.661332 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.661298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzm2\" (UniqueName: \"kubernetes.io/projected/c3240189-b454-439f-9e01-99101e4989bd-kube-api-access-ktzm2\") pod \"kuadrant-operator-catalog-554cn\" (UID: \"c3240189-b454-439f-9e01-99101e4989bd\") " pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:27.762889 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.762807 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzm2\" (UniqueName: \"kubernetes.io/projected/c3240189-b454-439f-9e01-99101e4989bd-kube-api-access-ktzm2\") pod \"kuadrant-operator-catalog-554cn\" (UID: \"c3240189-b454-439f-9e01-99101e4989bd\") " pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:27.771416 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.771383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzm2\" (UniqueName: \"kubernetes.io/projected/c3240189-b454-439f-9e01-99101e4989bd-kube-api-access-ktzm2\") pod \"kuadrant-operator-catalog-554cn\" (UID: \"c3240189-b454-439f-9e01-99101e4989bd\") " pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:27.824742 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.824692 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:27.962846 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:27.962810 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-554cn"] May 28 18:34:27.992316 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:27.992279 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3240189_b454_439f_9e01_99101e4989bd.slice/crio-0f5fe628ab46e4e0889efc41209b8732fecaead4ed159aedb2ee5cd2c2d59143 WatchSource:0}: Error finding container 0f5fe628ab46e4e0889efc41209b8732fecaead4ed159aedb2ee5cd2c2d59143: Status 404 returned error can't find the container with id 0f5fe628ab46e4e0889efc41209b8732fecaead4ed159aedb2ee5cd2c2d59143 May 28 18:34:28.541940 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:28.541890 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-554cn" event={"ID":"c3240189-b454-439f-9e01-99101e4989bd","Type":"ContainerStarted","Data":"0f5fe628ab46e4e0889efc41209b8732fecaead4ed159aedb2ee5cd2c2d59143"} May 28 18:34:29.546798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.546759 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-554cn" event={"ID":"c3240189-b454-439f-9e01-99101e4989bd","Type":"ContainerStarted","Data":"f254a8fe146189e608beb3e983052bbffbc6d8011061c0a50d04189390ccda17"} May 28 18:34:29.548124 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.548101 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" event={"ID":"b33c85b5-90be-4bcc-9262-744373067e35","Type":"ContainerStarted","Data":"7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875"} May 28 18:34:29.548241 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.548167 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" podUID="b33c85b5-90be-4bcc-9262-744373067e35" containerName="registry-server" containerID="cri-o://7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875" gracePeriod=2 May 28 18:34:29.563149 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.563053 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-554cn" podStartSLOduration=1.247765001 podStartE2EDuration="2.563039276s" podCreationTimestamp="2026-05-28 18:34:27 +0000 UTC" firstStartedPulling="2026-05-28 18:34:27.993589905 +0000 UTC m=+507.667725498" lastFinishedPulling="2026-05-28 18:34:29.308864174 +0000 UTC m=+508.982999773" observedRunningTime="2026-05-28 18:34:29.56137467 +0000 UTC m=+509.235510284" watchObservedRunningTime="2026-05-28 18:34:29.563039276 +0000 UTC m=+509.237174890" May 28 18:34:29.579898 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.579850 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" podStartSLOduration=1.6519781949999999 podStartE2EDuration="3.57983473s" podCreationTimestamp="2026-05-28 18:34:26 +0000 UTC" firstStartedPulling="2026-05-28 18:34:27.380271291 +0000 UTC m=+507.054407027" lastFinishedPulling="2026-05-28 18:34:29.308127967 +0000 UTC m=+508.982263562" observedRunningTime="2026-05-28 18:34:29.578869008 +0000 UTC m=+509.253004651" watchObservedRunningTime="2026-05-28 18:34:29.57983473 +0000 UTC m=+509.253970352" May 28 18:34:29.782727 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.782703 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:29.883841 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.883753 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbggj\" (UniqueName: \"kubernetes.io/projected/b33c85b5-90be-4bcc-9262-744373067e35-kube-api-access-fbggj\") pod \"b33c85b5-90be-4bcc-9262-744373067e35\" (UID: \"b33c85b5-90be-4bcc-9262-744373067e35\") " May 28 18:34:29.885989 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.885963 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33c85b5-90be-4bcc-9262-744373067e35-kube-api-access-fbggj" (OuterVolumeSpecName: "kube-api-access-fbggj") pod "b33c85b5-90be-4bcc-9262-744373067e35" (UID: "b33c85b5-90be-4bcc-9262-744373067e35"). InnerVolumeSpecName "kube-api-access-fbggj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:34:29.984868 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:29.984825 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbggj\" (UniqueName: \"kubernetes.io/projected/b33c85b5-90be-4bcc-9262-744373067e35-kube-api-access-fbggj\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:30.552823 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.552790 2559 generic.go:358] "Generic (PLEG): container finished" podID="b33c85b5-90be-4bcc-9262-744373067e35" containerID="7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875" exitCode=0 May 28 18:34:30.553288 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.552856 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" May 28 18:34:30.553288 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.552876 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" event={"ID":"b33c85b5-90be-4bcc-9262-744373067e35","Type":"ContainerDied","Data":"7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875"} May 28 18:34:30.553288 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.552913 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g7h47" event={"ID":"b33c85b5-90be-4bcc-9262-744373067e35","Type":"ContainerDied","Data":"c0272b607bd094467bdf44273e748c72509d82284cd9cb4f88b3d89c85f5e6c1"} May 28 18:34:30.553288 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.552929 2559 scope.go:117] "RemoveContainer" containerID="7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875" May 28 18:34:30.562105 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.562088 2559 scope.go:117] "RemoveContainer" containerID="7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875" May 28 18:34:30.562366 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:34:30.562349 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875\": container with ID starting with 7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875 not found: ID does not exist" containerID="7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875" May 28 18:34:30.562413 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.562375 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875"} err="failed to get container status \"7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875\": rpc error: code = NotFound desc = could not find container \"7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875\": container with ID starting with 7010a487f9ad7e05a101df5b00c3c2fc73dac8b041d0cd7b3af96b15d83af875 not found: ID does not exist" May 28 18:34:30.573993 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.573968 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7h47"] May 28 18:34:30.577646 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.577624 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7h47"] May 28 18:34:30.933491 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:30.933459 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33c85b5-90be-4bcc-9262-744373067e35" path="/var/lib/kubelet/pods/b33c85b5-90be-4bcc-9262-744373067e35/volumes" May 28 18:34:37.825617 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:37.825575 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:37.825617 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:37.825619 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:37.846903 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:37.846870 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:38.599412 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:38.599380 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-554cn" May 28 18:34:42.498579 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.498525 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8"] May 28 18:34:42.499142 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.498992 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33c85b5-90be-4bcc-9262-744373067e35" containerName="registry-server" May 28 18:34:42.499142 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.499010 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33c85b5-90be-4bcc-9262-744373067e35" containerName="registry-server" May 28 18:34:42.499142 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.499126 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b33c85b5-90be-4bcc-9262-744373067e35" containerName="registry-server" May 28 18:34:42.503802 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.503778 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.506367 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.506344 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7tjc6\"" May 28 18:34:42.512775 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.512750 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8"] May 28 18:34:42.591110 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.591073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75rbk\" (UniqueName: \"kubernetes.io/projected/8cd6f33e-f987-428c-895c-6b35b6a23fa0-kube-api-access-75rbk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.591287 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.591123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.591287 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.591243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.691787 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.691750 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.691957 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.691838 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.691957 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.691891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75rbk\" (UniqueName: \"kubernetes.io/projected/8cd6f33e-f987-428c-895c-6b35b6a23fa0-kube-api-access-75rbk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.692198 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.692166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.692286 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.692243 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.701466 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.701434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75rbk\" (UniqueName: \"kubernetes.io/projected/8cd6f33e-f987-428c-895c-6b35b6a23fa0-kube-api-access-75rbk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.813626 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.813502 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:42.944630 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:42.944604 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8"] May 28 18:34:42.947333 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:42.947304 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd6f33e_f987_428c_895c_6b35b6a23fa0.slice/crio-29917ae5be16348ea6566be9ed05905ffbea2e726b99ce05aeb5e6d0d38b69ba WatchSource:0}: Error finding container 29917ae5be16348ea6566be9ed05905ffbea2e726b99ce05aeb5e6d0d38b69ba: Status 404 returned error can't find the container with id 29917ae5be16348ea6566be9ed05905ffbea2e726b99ce05aeb5e6d0d38b69ba May 28 18:34:43.293489 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.293453 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn"] May 28 18:34:43.296812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.296796 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.305924 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.305901 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn"] May 28 18:34:43.397745 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.397711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.397957 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.397768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rtdh\" (UniqueName: \"kubernetes.io/projected/c3923878-8776-42e4-809b-34c4e3ec2d37-kube-api-access-7rtdh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.397957 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.397868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.498601 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.498568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.499003 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.498624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rtdh\" (UniqueName: \"kubernetes.io/projected/c3923878-8776-42e4-809b-34c4e3ec2d37-kube-api-access-7rtdh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.499003 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.498670 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.499003 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.498916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.499003 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.498993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.508615 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.508591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rtdh\" (UniqueName: \"kubernetes.io/projected/c3923878-8776-42e4-809b-34c4e3ec2d37-kube-api-access-7rtdh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.597463 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.597376 2559 generic.go:358] "Generic (PLEG): container finished" podID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerID="6ad4a29c092a20cd8bcc31981a6ed113ef7e678146290962bd8f6a5f60e12de5" exitCode=0 May 28 18:34:43.597632 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.597457 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" event={"ID":"8cd6f33e-f987-428c-895c-6b35b6a23fa0","Type":"ContainerDied","Data":"6ad4a29c092a20cd8bcc31981a6ed113ef7e678146290962bd8f6a5f60e12de5"} May 28 18:34:43.597632 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.597487 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" event={"ID":"8cd6f33e-f987-428c-895c-6b35b6a23fa0","Type":"ContainerStarted","Data":"29917ae5be16348ea6566be9ed05905ffbea2e726b99ce05aeb5e6d0d38b69ba"} May 28 18:34:43.606970 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.606949 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:43.744662 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.742686 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn"] May 28 18:34:43.748305 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:43.748270 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3923878_8776_42e4_809b_34c4e3ec2d37.slice/crio-106dff813a30954c07b23dfb17ef107a4c56450b6e5e34e56021bc26be60dd2d WatchSource:0}: Error finding container 106dff813a30954c07b23dfb17ef107a4c56450b6e5e34e56021bc26be60dd2d: Status 404 returned error can't find the container with id 106dff813a30954c07b23dfb17ef107a4c56450b6e5e34e56021bc26be60dd2d May 28 18:34:43.895334 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.895298 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8"] May 28 18:34:43.898904 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.898883 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:43.906327 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:43.906302 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8"] May 28 18:34:44.003199 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.003146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.003199 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.003201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpv68\" (UniqueName: \"kubernetes.io/projected/27097f19-4db6-44e4-bde1-5da2ba7f8262-kube-api-access-kpv68\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.003441 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.003311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.104826 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.104724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.104826 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.104778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpv68\" (UniqueName: \"kubernetes.io/projected/27097f19-4db6-44e4-bde1-5da2ba7f8262-kube-api-access-kpv68\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.105062 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.104874 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.105157 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.105138 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.105219 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.105165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.114561 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.114514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpv68\" (UniqueName: \"kubernetes.io/projected/27097f19-4db6-44e4-bde1-5da2ba7f8262-kube-api-access-kpv68\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.215284 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.215261 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:44.300655 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.300625 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9"] May 28 18:34:44.304777 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.304755 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.311335 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.311308 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9"] May 28 18:34:44.350960 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.350936 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8"] May 28 18:34:44.353486 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:44.353459 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27097f19_4db6_44e4_bde1_5da2ba7f8262.slice/crio-5a1f04dafda99fcb8e0031a5a40a770717954cce47ad33579573ce4622b5da48 WatchSource:0}: Error finding container 5a1f04dafda99fcb8e0031a5a40a770717954cce47ad33579573ce4622b5da48: Status 404 returned error can't find the container with id 5a1f04dafda99fcb8e0031a5a40a770717954cce47ad33579573ce4622b5da48 May 28 18:34:44.408700 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.408674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.408782 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.408706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.408859 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.408784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7664\" (UniqueName: \"kubernetes.io/projected/967467fc-5961-4364-90c3-83484d4e8d5d-kube-api-access-x7664\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.509887 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.509860 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7664\" (UniqueName: \"kubernetes.io/projected/967467fc-5961-4364-90c3-83484d4e8d5d-kube-api-access-x7664\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.510198 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.509961 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.510198 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.509980 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.510373 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.510350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.510409 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.510374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.532107 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.532080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7664\" (UniqueName: \"kubernetes.io/projected/967467fc-5961-4364-90c3-83484d4e8d5d-kube-api-access-x7664\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.603122 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.603097 2559 generic.go:358] "Generic (PLEG): container finished" podID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerID="e0beb25bc0325f2ee21d2c72bf461d5b1e46eaf98bffbf5ac9a6773976ff53de" exitCode=0 May 28 18:34:44.603209 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.603160 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" event={"ID":"8cd6f33e-f987-428c-895c-6b35b6a23fa0","Type":"ContainerDied","Data":"e0beb25bc0325f2ee21d2c72bf461d5b1e46eaf98bffbf5ac9a6773976ff53de"} May 28 18:34:44.604615 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.604589 2559 generic.go:358] "Generic (PLEG): container finished" podID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerID="a99afc93a5f29ac8cdd40a76586e0f6b2056908a86095958ad7f1210ee9aaee5" exitCode=0 May 28 18:34:44.604696 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.604616 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" event={"ID":"c3923878-8776-42e4-809b-34c4e3ec2d37","Type":"ContainerDied","Data":"a99afc93a5f29ac8cdd40a76586e0f6b2056908a86095958ad7f1210ee9aaee5"} May 28 18:34:44.604696 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.604644 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" event={"ID":"c3923878-8776-42e4-809b-34c4e3ec2d37","Type":"ContainerStarted","Data":"106dff813a30954c07b23dfb17ef107a4c56450b6e5e34e56021bc26be60dd2d"} May 28 18:34:44.606200 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.606176 2559 generic.go:358] "Generic (PLEG): container finished" podID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerID="e1433804d1a73dff474d51b8d30d94ed7c32ccd4ed5e571094387b8a755e8d86" exitCode=0 May 28 18:34:44.606285 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.606195 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" event={"ID":"27097f19-4db6-44e4-bde1-5da2ba7f8262","Type":"ContainerDied","Data":"e1433804d1a73dff474d51b8d30d94ed7c32ccd4ed5e571094387b8a755e8d86"} May 28 18:34:44.606285 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.606230 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" event={"ID":"27097f19-4db6-44e4-bde1-5da2ba7f8262","Type":"ContainerStarted","Data":"5a1f04dafda99fcb8e0031a5a40a770717954cce47ad33579573ce4622b5da48"} May 28 18:34:44.655252 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.655230 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:44.792127 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:44.792098 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9"] May 28 18:34:44.838317 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:34:44.838286 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967467fc_5961_4364_90c3_83484d4e8d5d.slice/crio-a0bcab4a6dc8063a54d1e80db24e3c0323bddbc64b39761deb3ee6d006d45b55 WatchSource:0}: Error finding container a0bcab4a6dc8063a54d1e80db24e3c0323bddbc64b39761deb3ee6d006d45b55: Status 404 returned error can't find the container with id a0bcab4a6dc8063a54d1e80db24e3c0323bddbc64b39761deb3ee6d006d45b55 May 28 18:34:45.611594 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.611563 2559 generic.go:358] "Generic (PLEG): container finished" podID="967467fc-5961-4364-90c3-83484d4e8d5d" containerID="b751f4096e16f82770af9ba888949a4b7583093161332d4e8854375cc0aad992" exitCode=0 May 28 18:34:45.612009 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.611625 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" event={"ID":"967467fc-5961-4364-90c3-83484d4e8d5d","Type":"ContainerDied","Data":"b751f4096e16f82770af9ba888949a4b7583093161332d4e8854375cc0aad992"} May 28 18:34:45.612009 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.611659 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" event={"ID":"967467fc-5961-4364-90c3-83484d4e8d5d","Type":"ContainerStarted","Data":"a0bcab4a6dc8063a54d1e80db24e3c0323bddbc64b39761deb3ee6d006d45b55"} May 28 18:34:45.613449 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.613422 2559 generic.go:358] "Generic (PLEG): container finished" podID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerID="0e6a7263299be4e5659b4227840b519dc612d64d35840ad8b6784ad955c2d49d" exitCode=0 May 28 18:34:45.613585 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.613502 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" event={"ID":"27097f19-4db6-44e4-bde1-5da2ba7f8262","Type":"ContainerDied","Data":"0e6a7263299be4e5659b4227840b519dc612d64d35840ad8b6784ad955c2d49d"} May 28 18:34:45.615437 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.615415 2559 generic.go:358] "Generic (PLEG): container finished" podID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerID="ce7385d3154f6f559d62767f789e5fa8266a273aa87acf1f8267b6d8fca4cd5d" exitCode=0 May 28 18:34:45.615527 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.615492 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" event={"ID":"8cd6f33e-f987-428c-895c-6b35b6a23fa0","Type":"ContainerDied","Data":"ce7385d3154f6f559d62767f789e5fa8266a273aa87acf1f8267b6d8fca4cd5d"} May 28 18:34:45.617094 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.617075 2559 generic.go:358] "Generic (PLEG): container finished" podID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerID="f728de23f34ecaee5044802c1db6b612da0166452448adcea7d48ceeea43ddb5" exitCode=0 May 28 18:34:45.617175 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:45.617156 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" event={"ID":"c3923878-8776-42e4-809b-34c4e3ec2d37","Type":"ContainerDied","Data":"f728de23f34ecaee5044802c1db6b612da0166452448adcea7d48ceeea43ddb5"} May 28 18:34:46.625527 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.625436 2559 generic.go:358] "Generic (PLEG): container finished" podID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerID="9d8e8daf17ba71ffb765c781456366e345df4505835ba91d4305f2bc777eb334" exitCode=0 May 28 18:34:46.625527 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.625489 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" event={"ID":"c3923878-8776-42e4-809b-34c4e3ec2d37","Type":"ContainerDied","Data":"9d8e8daf17ba71ffb765c781456366e345df4505835ba91d4305f2bc777eb334"} May 28 18:34:46.627033 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.627009 2559 generic.go:358] "Generic (PLEG): container finished" podID="967467fc-5961-4364-90c3-83484d4e8d5d" containerID="9f6fe6a16154a0c5fd260a56788cc47c56114acba7047b3d3c4249d9ce5ac75f" exitCode=0 May 28 18:34:46.627154 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.627080 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" event={"ID":"967467fc-5961-4364-90c3-83484d4e8d5d","Type":"ContainerDied","Data":"9f6fe6a16154a0c5fd260a56788cc47c56114acba7047b3d3c4249d9ce5ac75f"} May 28 18:34:46.628923 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.628903 2559 generic.go:358] "Generic (PLEG): container finished" podID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerID="7aba25c874da8a183a1455d9fb88d0b8499526ca74ad9a85973678644be2c523" exitCode=0 May 28 18:34:46.629018 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.628970 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" event={"ID":"27097f19-4db6-44e4-bde1-5da2ba7f8262","Type":"ContainerDied","Data":"7aba25c874da8a183a1455d9fb88d0b8499526ca74ad9a85973678644be2c523"} May 28 18:34:46.823261 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.823237 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:46.929371 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.929344 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75rbk\" (UniqueName: \"kubernetes.io/projected/8cd6f33e-f987-428c-895c-6b35b6a23fa0-kube-api-access-75rbk\") pod \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " May 28 18:34:46.929530 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.929382 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-bundle\") pod \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " May 28 18:34:46.929530 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.929420 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-util\") pod \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\" (UID: \"8cd6f33e-f987-428c-895c-6b35b6a23fa0\") " May 28 18:34:46.930039 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.930001 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-bundle" (OuterVolumeSpecName: "bundle") pod "8cd6f33e-f987-428c-895c-6b35b6a23fa0" (UID: "8cd6f33e-f987-428c-895c-6b35b6a23fa0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:46.931474 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.931449 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd6f33e-f987-428c-895c-6b35b6a23fa0-kube-api-access-75rbk" (OuterVolumeSpecName: "kube-api-access-75rbk") pod "8cd6f33e-f987-428c-895c-6b35b6a23fa0" (UID: "8cd6f33e-f987-428c-895c-6b35b6a23fa0"). InnerVolumeSpecName "kube-api-access-75rbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:34:46.935093 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:46.935068 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-util" (OuterVolumeSpecName: "util") pod "8cd6f33e-f987-428c-895c-6b35b6a23fa0" (UID: "8cd6f33e-f987-428c-895c-6b35b6a23fa0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:47.030128 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.030092 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75rbk\" (UniqueName: \"kubernetes.io/projected/8cd6f33e-f987-428c-895c-6b35b6a23fa0-kube-api-access-75rbk\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.030128 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.030124 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.030312 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.030137 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cd6f33e-f987-428c-895c-6b35b6a23fa0-util\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.634142 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.634110 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" May 28 18:34:47.634568 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.634111 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8" event={"ID":"8cd6f33e-f987-428c-895c-6b35b6a23fa0","Type":"ContainerDied","Data":"29917ae5be16348ea6566be9ed05905ffbea2e726b99ce05aeb5e6d0d38b69ba"} May 28 18:34:47.634568 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.634238 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29917ae5be16348ea6566be9ed05905ffbea2e726b99ce05aeb5e6d0d38b69ba" May 28 18:34:47.636061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.636029 2559 generic.go:358] "Generic (PLEG): container finished" podID="967467fc-5961-4364-90c3-83484d4e8d5d" containerID="f9e41ea4ca550aa54f1b65325246dd489cde2b56392d9c2b788c440b50e9937b" exitCode=0 May 28 18:34:47.636194 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.636073 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" event={"ID":"967467fc-5961-4364-90c3-83484d4e8d5d","Type":"ContainerDied","Data":"f9e41ea4ca550aa54f1b65325246dd489cde2b56392d9c2b788c440b50e9937b"} May 28 18:34:47.788298 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.788279 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:47.791344 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.791327 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:47.834732 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.834707 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-bundle\") pod \"c3923878-8776-42e4-809b-34c4e3ec2d37\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " May 28 18:34:47.834884 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.834749 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-util\") pod \"27097f19-4db6-44e4-bde1-5da2ba7f8262\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " May 28 18:34:47.834884 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.834778 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-bundle\") pod \"27097f19-4db6-44e4-bde1-5da2ba7f8262\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " May 28 18:34:47.834884 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.834808 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpv68\" (UniqueName: \"kubernetes.io/projected/27097f19-4db6-44e4-bde1-5da2ba7f8262-kube-api-access-kpv68\") pod \"27097f19-4db6-44e4-bde1-5da2ba7f8262\" (UID: \"27097f19-4db6-44e4-bde1-5da2ba7f8262\") " May 28 18:34:47.835042 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.834888 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rtdh\" (UniqueName: \"kubernetes.io/projected/c3923878-8776-42e4-809b-34c4e3ec2d37-kube-api-access-7rtdh\") pod \"c3923878-8776-42e4-809b-34c4e3ec2d37\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " May 28 18:34:47.835308 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.835292 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-util\") pod \"c3923878-8776-42e4-809b-34c4e3ec2d37\" (UID: \"c3923878-8776-42e4-809b-34c4e3ec2d37\") " May 28 18:34:47.835379 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.835341 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-bundle" (OuterVolumeSpecName: "bundle") pod "27097f19-4db6-44e4-bde1-5da2ba7f8262" (UID: "27097f19-4db6-44e4-bde1-5da2ba7f8262"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:47.835825 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.835785 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-bundle" (OuterVolumeSpecName: "bundle") pod "c3923878-8776-42e4-809b-34c4e3ec2d37" (UID: "c3923878-8776-42e4-809b-34c4e3ec2d37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:47.836268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.836232 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.836268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.836260 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.837918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.837280 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3923878-8776-42e4-809b-34c4e3ec2d37-kube-api-access-7rtdh" (OuterVolumeSpecName: "kube-api-access-7rtdh") pod "c3923878-8776-42e4-809b-34c4e3ec2d37" (UID: "c3923878-8776-42e4-809b-34c4e3ec2d37"). InnerVolumeSpecName "kube-api-access-7rtdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:34:47.837918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.837401 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27097f19-4db6-44e4-bde1-5da2ba7f8262-kube-api-access-kpv68" (OuterVolumeSpecName: "kube-api-access-kpv68") pod "27097f19-4db6-44e4-bde1-5da2ba7f8262" (UID: "27097f19-4db6-44e4-bde1-5da2ba7f8262"). InnerVolumeSpecName "kube-api-access-kpv68". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:34:47.841708 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.841683 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-util" (OuterVolumeSpecName: "util") pod "27097f19-4db6-44e4-bde1-5da2ba7f8262" (UID: "27097f19-4db6-44e4-bde1-5da2ba7f8262"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:47.844504 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.844463 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-util" (OuterVolumeSpecName: "util") pod "c3923878-8776-42e4-809b-34c4e3ec2d37" (UID: "c3923878-8776-42e4-809b-34c4e3ec2d37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:47.936874 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.936849 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3923878-8776-42e4-809b-34c4e3ec2d37-util\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.936874 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.936874 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27097f19-4db6-44e4-bde1-5da2ba7f8262-util\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.937015 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.936884 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpv68\" (UniqueName: \"kubernetes.io/projected/27097f19-4db6-44e4-bde1-5da2ba7f8262-kube-api-access-kpv68\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:47.937015 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:47.936895 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rtdh\" (UniqueName: \"kubernetes.io/projected/c3923878-8776-42e4-809b-34c4e3ec2d37-kube-api-access-7rtdh\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:48.641420 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.641394 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" May 28 18:34:48.641420 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.641404 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn" event={"ID":"c3923878-8776-42e4-809b-34c4e3ec2d37","Type":"ContainerDied","Data":"106dff813a30954c07b23dfb17ef107a4c56450b6e5e34e56021bc26be60dd2d"} May 28 18:34:48.641898 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.641434 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="106dff813a30954c07b23dfb17ef107a4c56450b6e5e34e56021bc26be60dd2d" May 28 18:34:48.643061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.643038 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" May 28 18:34:48.643061 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.643042 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8" event={"ID":"27097f19-4db6-44e4-bde1-5da2ba7f8262","Type":"ContainerDied","Data":"5a1f04dafda99fcb8e0031a5a40a770717954cce47ad33579573ce4622b5da48"} May 28 18:34:48.643205 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.643078 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a1f04dafda99fcb8e0031a5a40a770717954cce47ad33579573ce4622b5da48" May 28 18:34:48.754058 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.754038 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:48.845243 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.845218 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7664\" (UniqueName: \"kubernetes.io/projected/967467fc-5961-4364-90c3-83484d4e8d5d-kube-api-access-x7664\") pod \"967467fc-5961-4364-90c3-83484d4e8d5d\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " May 28 18:34:48.845352 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.845257 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-bundle\") pod \"967467fc-5961-4364-90c3-83484d4e8d5d\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " May 28 18:34:48.845352 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.845334 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-util\") pod \"967467fc-5961-4364-90c3-83484d4e8d5d\" (UID: \"967467fc-5961-4364-90c3-83484d4e8d5d\") " May 28 18:34:48.845849 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.845817 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-bundle" (OuterVolumeSpecName: "bundle") pod "967467fc-5961-4364-90c3-83484d4e8d5d" (UID: "967467fc-5961-4364-90c3-83484d4e8d5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:48.847299 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.847273 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967467fc-5961-4364-90c3-83484d4e8d5d-kube-api-access-x7664" (OuterVolumeSpecName: "kube-api-access-x7664") pod "967467fc-5961-4364-90c3-83484d4e8d5d" (UID: "967467fc-5961-4364-90c3-83484d4e8d5d"). InnerVolumeSpecName "kube-api-access-x7664". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:34:48.851165 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.851143 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-util" (OuterVolumeSpecName: "util") pod "967467fc-5961-4364-90c3-83484d4e8d5d" (UID: "967467fc-5961-4364-90c3-83484d4e8d5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:34:48.946254 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.946232 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-util\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:48.946254 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.946255 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7664\" (UniqueName: \"kubernetes.io/projected/967467fc-5961-4364-90c3-83484d4e8d5d-kube-api-access-x7664\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:48.946396 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:48.946264 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/967467fc-5961-4364-90c3-83484d4e8d5d-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:34:49.648225 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:49.648197 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" May 28 18:34:49.648225 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:49.648205 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9" event={"ID":"967467fc-5961-4364-90c3-83484d4e8d5d","Type":"ContainerDied","Data":"a0bcab4a6dc8063a54d1e80db24e3c0323bddbc64b39761deb3ee6d006d45b55"} May 28 18:34:49.648651 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:34:49.648235 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0bcab4a6dc8063a54d1e80db24e3c0323bddbc64b39761deb3ee6d006d45b55" May 28 18:35:01.102665 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102593 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn"] May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102903 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="extract" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102915 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="extract" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102927 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="util" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102932 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="util" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102940 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="util" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102944 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="util" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102951 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="extract" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102956 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="extract" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102964 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="pull" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102969 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="pull" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102976 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="extract" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102982 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="extract" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102990 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="pull" May 28 18:35:01.102991 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.102995 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="pull" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103003 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="util" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103008 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="util" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103014 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="pull" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103019 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="pull" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103029 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="util" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103034 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="util" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103039 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="extract" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103043 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="extract" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103048 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="pull" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103053 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="pull" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103099 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="27097f19-4db6-44e4-bde1-5da2ba7f8262" containerName="extract" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103107 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3923878-8776-42e4-809b-34c4e3ec2d37" containerName="extract" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103113 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd6f33e-f987-428c-895c-6b35b6a23fa0" containerName="extract" May 28 18:35:01.103365 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.103118 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="967467fc-5961-4364-90c3-83484d4e8d5d" containerName="extract" May 28 18:35:01.110551 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.110518 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.114563 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.114528 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kdvk5\"" May 28 18:35:01.141758 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.141733 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn"] May 28 18:35:01.246868 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.246843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b2df7ac-4d28-42e1-9863-214b41ae5e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.246969 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.246874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx4zr\" (UniqueName: \"kubernetes.io/projected/7b2df7ac-4d28-42e1-9863-214b41ae5e98-kube-api-access-sx4zr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.347810 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.347781 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b2df7ac-4d28-42e1-9863-214b41ae5e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.347810 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.347811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sx4zr\" (UniqueName: \"kubernetes.io/projected/7b2df7ac-4d28-42e1-9863-214b41ae5e98-kube-api-access-sx4zr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.348161 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.348136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b2df7ac-4d28-42e1-9863-214b41ae5e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.358893 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.358840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx4zr\" (UniqueName: \"kubernetes.io/projected/7b2df7ac-4d28-42e1-9863-214b41ae5e98-kube-api-access-sx4zr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.420704 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.420680 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:01.556194 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.556144 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn"] May 28 18:35:01.559405 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:01.559369 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2df7ac_4d28_42e1_9863_214b41ae5e98.slice/crio-0aab3e46538077dfb838c89881417cfaea572c30b762f4aebc252cd95359d59a WatchSource:0}: Error finding container 0aab3e46538077dfb838c89881417cfaea572c30b762f4aebc252cd95359d59a: Status 404 returned error can't find the container with id 0aab3e46538077dfb838c89881417cfaea572c30b762f4aebc252cd95359d59a May 28 18:35:01.690595 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:01.690568 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" event={"ID":"7b2df7ac-4d28-42e1-9863-214b41ae5e98","Type":"ContainerStarted","Data":"0aab3e46538077dfb838c89881417cfaea572c30b762f4aebc252cd95359d59a"} May 28 18:35:05.741117 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.741081 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9ggzc"] May 28 18:35:05.745127 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.745105 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:05.747903 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.747880 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qtkdh\"" May 28 18:35:05.756311 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.756287 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9ggzc"] May 28 18:35:05.788104 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.788067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2746r\" (UniqueName: \"kubernetes.io/projected/e8524b7f-4d96-4630-a40b-05c29bec79e5-kube-api-access-2746r\") pod \"authorino-operator-657f44b778-9ggzc\" (UID: \"e8524b7f-4d96-4630-a40b-05c29bec79e5\") " pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:05.888695 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.888670 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2746r\" (UniqueName: \"kubernetes.io/projected/e8524b7f-4d96-4630-a40b-05c29bec79e5-kube-api-access-2746r\") pod \"authorino-operator-657f44b778-9ggzc\" (UID: \"e8524b7f-4d96-4630-a40b-05c29bec79e5\") " pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:05.902100 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:05.902078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2746r\" (UniqueName: \"kubernetes.io/projected/e8524b7f-4d96-4630-a40b-05c29bec79e5-kube-api-access-2746r\") pod \"authorino-operator-657f44b778-9ggzc\" (UID: \"e8524b7f-4d96-4630-a40b-05c29bec79e5\") " pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:06.058644 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.058567 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:06.189932 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.189903 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9ggzc"] May 28 18:35:06.191568 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:06.191517 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8524b7f_4d96_4630_a40b_05c29bec79e5.slice/crio-3960780b4d13642aef6b580d4c4933cff18486d86f8b5d9dfe07f70b2ac53b19 WatchSource:0}: Error finding container 3960780b4d13642aef6b580d4c4933cff18486d86f8b5d9dfe07f70b2ac53b19: Status 404 returned error can't find the container with id 3960780b4d13642aef6b580d4c4933cff18486d86f8b5d9dfe07f70b2ac53b19 May 28 18:35:06.714572 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.714470 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" event={"ID":"7b2df7ac-4d28-42e1-9863-214b41ae5e98","Type":"ContainerStarted","Data":"08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788"} May 28 18:35:06.714767 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.714692 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:06.715783 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.715752 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" event={"ID":"e8524b7f-4d96-4630-a40b-05c29bec79e5","Type":"ContainerStarted","Data":"3960780b4d13642aef6b580d4c4933cff18486d86f8b5d9dfe07f70b2ac53b19"} May 28 18:35:06.740178 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.740123 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" podStartSLOduration=1.415311094 podStartE2EDuration="5.740109919s" podCreationTimestamp="2026-05-28 18:35:01 +0000 UTC" firstStartedPulling="2026-05-28 18:35:01.56191283 +0000 UTC m=+541.236048422" lastFinishedPulling="2026-05-28 18:35:05.886711651 +0000 UTC m=+545.560847247" observedRunningTime="2026-05-28 18:35:06.738867112 +0000 UTC m=+546.413002728" watchObservedRunningTime="2026-05-28 18:35:06.740109919 +0000 UTC m=+546.414245539" May 28 18:35:06.839339 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.839305 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fb6c4846-94gjf"] May 28 18:35:06.843029 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.843006 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.858279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.858047 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fb6c4846-94gjf"] May 28 18:35:06.898050 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-oauth-config\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.898207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-serving-cert\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.898207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-oauth-serving-cert\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.898207 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-trusted-ca-bundle\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.898373 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d28hq\" (UniqueName: \"kubernetes.io/projected/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-kube-api-access-d28hq\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.898373 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-config\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.898373 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.898285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-service-ca\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999059 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.998968 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d28hq\" (UniqueName: \"kubernetes.io/projected/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-kube-api-access-d28hq\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999059 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-config\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999076 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-service-ca\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999134 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-oauth-config\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999184 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-serving-cert\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999213 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-oauth-serving-cert\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:06.999279 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999242 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-trusted-ca-bundle\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.000157 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:06.999930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-config\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.000157 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.000029 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-trusted-ca-bundle\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.000355 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.000300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-service-ca\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.000594 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.000483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-oauth-serving-cert\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.002747 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.002699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-oauth-config\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.002906 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.002864 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-console-serving-cert\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.009679 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.009632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d28hq\" (UniqueName: \"kubernetes.io/projected/b9ab7465-4a1e-46bc-b4fd-b3a4e684e781-kube-api-access-d28hq\") pod \"console-85fb6c4846-94gjf\" (UID: \"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781\") " pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.160162 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.160102 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:07.321319 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.321293 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fb6c4846-94gjf"] May 28 18:35:07.323799 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:07.323759 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ab7465_4a1e_46bc_b4fd_b3a4e684e781.slice/crio-b8f3490776d8d7f6b01d5a62e9dfcc63ce4a5c9a007b5db2e7852c11838f136e WatchSource:0}: Error finding container b8f3490776d8d7f6b01d5a62e9dfcc63ce4a5c9a007b5db2e7852c11838f136e: Status 404 returned error can't find the container with id b8f3490776d8d7f6b01d5a62e9dfcc63ce4a5c9a007b5db2e7852c11838f136e May 28 18:35:07.722752 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.722663 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fb6c4846-94gjf" event={"ID":"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781","Type":"ContainerStarted","Data":"1bfd1f539ff0849f9fb74fb5a9b8870aa742bbbca7dba7ac4d93ca5bb23fe616"} May 28 18:35:07.722752 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.722718 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fb6c4846-94gjf" event={"ID":"b9ab7465-4a1e-46bc-b4fd-b3a4e684e781","Type":"ContainerStarted","Data":"b8f3490776d8d7f6b01d5a62e9dfcc63ce4a5c9a007b5db2e7852c11838f136e"} May 28 18:35:07.764296 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:07.764238 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-85fb6c4846-94gjf" podStartSLOduration=1.764220807 podStartE2EDuration="1.764220807s" podCreationTimestamp="2026-05-28 18:35:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:07.762364807 +0000 UTC m=+547.436500425" watchObservedRunningTime="2026-05-28 18:35:07.764220807 +0000 UTC m=+547.438356423" May 28 18:35:08.728025 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:08.727930 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" event={"ID":"e8524b7f-4d96-4630-a40b-05c29bec79e5","Type":"ContainerStarted","Data":"d65a4117616f943ed9e1ff58e726970a36bb4c8e415e2b0a2c8b148acc889ab2"} May 28 18:35:08.728025 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:08.728002 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:08.749736 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:08.749678 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" podStartSLOduration=1.504344389 podStartE2EDuration="3.749664718s" podCreationTimestamp="2026-05-28 18:35:05 +0000 UTC" firstStartedPulling="2026-05-28 18:35:06.193579814 +0000 UTC m=+545.867715407" lastFinishedPulling="2026-05-28 18:35:08.438900141 +0000 UTC m=+548.113035736" observedRunningTime="2026-05-28 18:35:08.748320069 +0000 UTC m=+548.422455686" watchObservedRunningTime="2026-05-28 18:35:08.749664718 +0000 UTC m=+548.423800337" May 28 18:35:17.160794 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:17.160756 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:17.160794 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:17.160799 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:17.165664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:17.165641 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:17.725043 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:17.725016 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:17.767245 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:17.767217 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85fb6c4846-94gjf" May 28 18:35:17.821891 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:17.821856 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfccb67cd-zgm9k"] May 28 18:35:19.520982 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.520944 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn"] May 28 18:35:19.521515 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.521437 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" containerName="manager" containerID="cri-o://08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788" gracePeriod=2 May 28 18:35:19.523633 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.523576 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:19.524460 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.524416 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn"] May 28 18:35:19.541656 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.541631 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx"] May 28 18:35:19.542058 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.542040 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" containerName="manager" May 28 18:35:19.542145 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.542060 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" containerName="manager" May 28 18:35:19.542197 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.542154 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" containerName="manager" May 28 18:35:19.544604 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.544585 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.554350 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.554327 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx"] May 28 18:35:19.572916 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.572873 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:19.619222 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.619195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrxp6\" (UniqueName: \"kubernetes.io/projected/db10c2eb-22a0-48f3-adf8-82b852b216a8-kube-api-access-wrxp6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g66nx\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.619354 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.619327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db10c2eb-22a0-48f3-adf8-82b852b216a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g66nx\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.720159 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.720121 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db10c2eb-22a0-48f3-adf8-82b852b216a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g66nx\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.720325 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.720189 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxp6\" (UniqueName: \"kubernetes.io/projected/db10c2eb-22a0-48f3-adf8-82b852b216a8-kube-api-access-wrxp6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g66nx\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.720489 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.720466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db10c2eb-22a0-48f3-adf8-82b852b216a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g66nx\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.728171 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.728131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrxp6\" (UniqueName: \"kubernetes.io/projected/db10c2eb-22a0-48f3-adf8-82b852b216a8-kube-api-access-wrxp6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-g66nx\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.734381 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.734362 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-9ggzc" May 28 18:35:19.747532 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.747515 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:19.752939 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.752913 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:19.754663 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.754639 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:19.771487 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.771422 2559 generic.go:358] "Generic (PLEG): container finished" podID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" containerID="08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788" exitCode=0 May 28 18:35:19.771487 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.771462 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" May 28 18:35:19.771666 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.771525 2559 scope.go:117] "RemoveContainer" containerID="08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788" May 28 18:35:19.773811 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.773784 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:19.779804 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.779786 2559 scope.go:117] "RemoveContainer" containerID="08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788" May 28 18:35:19.780036 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:35:19.780016 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788\": container with ID starting with 08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788 not found: ID does not exist" containerID="08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788" May 28 18:35:19.780086 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.780045 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788"} err="failed to get container status \"08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788\": rpc error: code = NotFound desc = could not find container \"08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788\": container with ID starting with 08d60769fc09a48aaeea0f1e03de7b013e56a519d67d07c326ff3e04df45c788 not found: ID does not exist" May 28 18:35:19.820935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.820915 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b2df7ac-4d28-42e1-9863-214b41ae5e98-extensions-socket-volume\") pod \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " May 28 18:35:19.821055 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.821012 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx4zr\" (UniqueName: \"kubernetes.io/projected/7b2df7ac-4d28-42e1-9863-214b41ae5e98-kube-api-access-sx4zr\") pod \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\" (UID: \"7b2df7ac-4d28-42e1-9863-214b41ae5e98\") " May 28 18:35:19.821382 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.821360 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2df7ac-4d28-42e1-9863-214b41ae5e98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b2df7ac-4d28-42e1-9863-214b41ae5e98" (UID: "7b2df7ac-4d28-42e1-9863-214b41ae5e98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:35:19.822941 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.822921 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2df7ac-4d28-42e1-9863-214b41ae5e98-kube-api-access-sx4zr" (OuterVolumeSpecName: "kube-api-access-sx4zr") pod "7b2df7ac-4d28-42e1-9863-214b41ae5e98" (UID: "7b2df7ac-4d28-42e1-9863-214b41ae5e98"). InnerVolumeSpecName "kube-api-access-sx4zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:35:19.903310 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.903285 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:19.921899 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.921877 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx4zr\" (UniqueName: \"kubernetes.io/projected/7b2df7ac-4d28-42e1-9863-214b41ae5e98-kube-api-access-sx4zr\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:19.921899 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:19.921899 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b2df7ac-4d28-42e1-9863-214b41ae5e98-extensions-socket-volume\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:20.034983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.034932 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx"] May 28 18:35:20.037376 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:20.037352 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb10c2eb_22a0_48f3_adf8_82b852b216a8.slice/crio-240c8e1da782281ea85c5b28f1ac2a96a9f26a19749cd7fe20a5ee0ea8cc3405 WatchSource:0}: Error finding container 240c8e1da782281ea85c5b28f1ac2a96a9f26a19749cd7fe20a5ee0ea8cc3405: Status 404 returned error can't find the container with id 240c8e1da782281ea85c5b28f1ac2a96a9f26a19749cd7fe20a5ee0ea8cc3405 May 28 18:35:20.082352 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.082319 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:20.777363 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.777330 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" event={"ID":"db10c2eb-22a0-48f3-adf8-82b852b216a8","Type":"ContainerStarted","Data":"abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2"} May 28 18:35:20.777363 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.777366 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" event={"ID":"db10c2eb-22a0-48f3-adf8-82b852b216a8","Type":"ContainerStarted","Data":"240c8e1da782281ea85c5b28f1ac2a96a9f26a19749cd7fe20a5ee0ea8cc3405"} May 28 18:35:20.777833 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.777412 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:20.816599 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.816550 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" podStartSLOduration=1.816519462 podStartE2EDuration="1.816519462s" podCreationTimestamp="2026-05-28 18:35:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:20.814735798 +0000 UTC m=+560.488871408" watchObservedRunningTime="2026-05-28 18:35:20.816519462 +0000 UTC m=+560.490655077" May 28 18:35:20.818589 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.818565 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:20.933814 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.933781 2559 status_manager.go:895] "Failed to get status for pod" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n9dbn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-n9dbn\" is forbidden: User \"system:node:ip-10-0-140-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-205.ec2.internal' and this object" May 28 18:35:20.934770 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:20.934750 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b2df7ac-4d28-42e1-9863-214b41ae5e98" path="/var/lib/kubelet/pods/7b2df7ac-4d28-42e1-9863-214b41ae5e98/volumes" May 28 18:35:31.784474 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:31.784444 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:35.723935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:35.723896 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx"] May 28 18:35:35.724327 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:35.724121 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" podUID="db10c2eb-22a0-48f3-adf8-82b852b216a8" containerName="manager" containerID="cri-o://abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2" gracePeriod=10 May 28 18:35:36.773421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.773392 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:36.837715 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.837634 2559 generic.go:358] "Generic (PLEG): container finished" podID="db10c2eb-22a0-48f3-adf8-82b852b216a8" containerID="abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2" exitCode=0 May 28 18:35:36.837715 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.837699 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" May 28 18:35:36.837896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.837727 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" event={"ID":"db10c2eb-22a0-48f3-adf8-82b852b216a8","Type":"ContainerDied","Data":"abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2"} May 28 18:35:36.837896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.837768 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx" event={"ID":"db10c2eb-22a0-48f3-adf8-82b852b216a8","Type":"ContainerDied","Data":"240c8e1da782281ea85c5b28f1ac2a96a9f26a19749cd7fe20a5ee0ea8cc3405"} May 28 18:35:36.837896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.837787 2559 scope.go:117] "RemoveContainer" containerID="abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2" May 28 18:35:36.846234 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.846219 2559 scope.go:117] "RemoveContainer" containerID="abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2" May 28 18:35:36.846518 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:35:36.846491 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2\": container with ID starting with abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2 not found: ID does not exist" containerID="abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2" May 28 18:35:36.846594 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.846527 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2"} err="failed to get container status \"abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2\": rpc error: code = NotFound desc = could not find container \"abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2\": container with ID starting with abbb1c5239c8d31c759005abb631c5190c629cfa4666c1302a4b85ef61df25a2 not found: ID does not exist" May 28 18:35:36.864849 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.864815 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db10c2eb-22a0-48f3-adf8-82b852b216a8-extensions-socket-volume\") pod \"db10c2eb-22a0-48f3-adf8-82b852b216a8\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " May 28 18:35:36.864952 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.864856 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrxp6\" (UniqueName: \"kubernetes.io/projected/db10c2eb-22a0-48f3-adf8-82b852b216a8-kube-api-access-wrxp6\") pod \"db10c2eb-22a0-48f3-adf8-82b852b216a8\" (UID: \"db10c2eb-22a0-48f3-adf8-82b852b216a8\") " May 28 18:35:36.865191 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.865168 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db10c2eb-22a0-48f3-adf8-82b852b216a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db10c2eb-22a0-48f3-adf8-82b852b216a8" (UID: "db10c2eb-22a0-48f3-adf8-82b852b216a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 18:35:36.866767 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.866742 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db10c2eb-22a0-48f3-adf8-82b852b216a8-kube-api-access-wrxp6" (OuterVolumeSpecName: "kube-api-access-wrxp6") pod "db10c2eb-22a0-48f3-adf8-82b852b216a8" (UID: "db10c2eb-22a0-48f3-adf8-82b852b216a8"). InnerVolumeSpecName "kube-api-access-wrxp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:35:36.965486 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.965456 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db10c2eb-22a0-48f3-adf8-82b852b216a8-extensions-socket-volume\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:36.965486 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:36.965480 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrxp6\" (UniqueName: \"kubernetes.io/projected/db10c2eb-22a0-48f3-adf8-82b852b216a8-kube-api-access-wrxp6\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:37.158372 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:37.158338 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx"] May 28 18:35:37.168688 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:37.168661 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-g66nx"] May 28 18:35:38.934331 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:38.934299 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db10c2eb-22a0-48f3-adf8-82b852b216a8" path="/var/lib/kubelet/pods/db10c2eb-22a0-48f3-adf8-82b852b216a8/volumes" May 28 18:35:42.847634 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:42.847597 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5dfccb67cd-zgm9k" podUID="b81e3eef-e755-4c97-a7ec-572bd2f1e990" containerName="console" containerID="cri-o://f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd" gracePeriod=15 May 28 18:35:43.105007 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.104952 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dfccb67cd-zgm9k_b81e3eef-e755-4c97-a7ec-572bd2f1e990/console/0.log" May 28 18:35:43.105127 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.105013 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:35:43.211888 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.211861 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-oauth-serving-cert\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212040 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.211897 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-serving-cert\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212040 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.211919 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-trusted-ca-bundle\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212040 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.211938 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjc4f\" (UniqueName: \"kubernetes.io/projected/b81e3eef-e755-4c97-a7ec-572bd2f1e990-kube-api-access-cjc4f\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212040 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.211984 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-oauth-config\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212040 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.212002 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-service-ca\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212040 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.212041 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-config\") pod \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\" (UID: \"b81e3eef-e755-4c97-a7ec-572bd2f1e990\") " May 28 18:35:43.212516 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.212433 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:35:43.212516 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.212452 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-service-ca" (OuterVolumeSpecName: "service-ca") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:35:43.212516 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.212472 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:35:43.212722 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.212519 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-config" (OuterVolumeSpecName: "console-config") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:35:43.214097 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.214074 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:35:43.214180 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.214140 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81e3eef-e755-4c97-a7ec-572bd2f1e990-kube-api-access-cjc4f" (OuterVolumeSpecName: "kube-api-access-cjc4f") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "kube-api-access-cjc4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:35:43.214268 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.214248 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b81e3eef-e755-4c97-a7ec-572bd2f1e990" (UID: "b81e3eef-e755-4c97-a7ec-572bd2f1e990"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 18:35:43.312709 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312683 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.312709 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312705 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-oauth-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.312829 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312715 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-serving-cert\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.312829 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312726 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-trusted-ca-bundle\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.312829 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312734 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjc4f\" (UniqueName: \"kubernetes.io/projected/b81e3eef-e755-4c97-a7ec-572bd2f1e990-kube-api-access-cjc4f\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.312829 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312743 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b81e3eef-e755-4c97-a7ec-572bd2f1e990-console-oauth-config\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.312829 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.312752 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b81e3eef-e755-4c97-a7ec-572bd2f1e990-service-ca\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:35:43.865598 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.865574 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dfccb67cd-zgm9k_b81e3eef-e755-4c97-a7ec-572bd2f1e990/console/0.log" May 28 18:35:43.865985 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.865610 2559 generic.go:358] "Generic (PLEG): container finished" podID="b81e3eef-e755-4c97-a7ec-572bd2f1e990" containerID="f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd" exitCode=2 May 28 18:35:43.865985 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.865675 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfccb67cd-zgm9k" May 28 18:35:43.865985 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.865698 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfccb67cd-zgm9k" event={"ID":"b81e3eef-e755-4c97-a7ec-572bd2f1e990","Type":"ContainerDied","Data":"f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd"} May 28 18:35:43.865985 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.865739 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfccb67cd-zgm9k" event={"ID":"b81e3eef-e755-4c97-a7ec-572bd2f1e990","Type":"ContainerDied","Data":"d57d100b6f5a13d5fb8e839834b22d25526e5fda12c8dfff199fb43f03bf62ba"} May 28 18:35:43.865985 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.865758 2559 scope.go:117] "RemoveContainer" containerID="f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd" May 28 18:35:43.874935 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.874919 2559 scope.go:117] "RemoveContainer" containerID="f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd" May 28 18:35:43.875159 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:35:43.875140 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd\": container with ID starting with f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd not found: ID does not exist" containerID="f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd" May 28 18:35:43.875227 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.875165 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd"} err="failed to get container status \"f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd\": rpc error: code = NotFound desc = could not find container \"f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd\": container with ID starting with f07df3fcf5ca88734a91fef047464459a30ae751964789132cf5cd7f82bac0cd not found: ID does not exist" May 28 18:35:43.888630 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.888609 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfccb67cd-zgm9k"] May 28 18:35:43.892170 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:43.892148 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfccb67cd-zgm9k"] May 28 18:35:44.934022 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:44.933992 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b81e3eef-e755-4c97-a7ec-572bd2f1e990" path="/var/lib/kubelet/pods/b81e3eef-e755-4c97-a7ec-572bd2f1e990/volumes" May 28 18:35:51.982886 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.982855 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r"] May 28 18:35:51.983913 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.983888 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b81e3eef-e755-4c97-a7ec-572bd2f1e990" containerName="console" May 28 18:35:51.984055 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.984045 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b81e3eef-e755-4c97-a7ec-572bd2f1e990" containerName="console" May 28 18:35:51.984169 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.984159 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db10c2eb-22a0-48f3-adf8-82b852b216a8" containerName="manager" May 28 18:35:51.984245 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.984236 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="db10c2eb-22a0-48f3-adf8-82b852b216a8" containerName="manager" May 28 18:35:51.984408 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.984398 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="db10c2eb-22a0-48f3-adf8-82b852b216a8" containerName="manager" May 28 18:35:51.984483 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.984474 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b81e3eef-e755-4c97-a7ec-572bd2f1e990" containerName="console" May 28 18:35:51.987856 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.987833 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:51.990732 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:51.990711 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cvz9j\"" May 28 18:35:52.006521 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.006490 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r"] May 28 18:35:52.082290 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhpb\" (UniqueName: \"kubernetes.io/projected/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-kube-api-access-rnhpb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.082664 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.082627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183298 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183263 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhpb\" (UniqueName: \"kubernetes.io/projected/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-kube-api-access-rnhpb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183298 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183297 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183513 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183324 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183513 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183360 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183513 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183395 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183513 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183417 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183513 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183438 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183513 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183495 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183856 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183590 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183856 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183964 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.183964 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.183911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.184129 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.184106 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.184271 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.184255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.185572 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.185549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.185789 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.185771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.191458 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.191424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.191585 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.191469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhpb\" (UniqueName: \"kubernetes.io/projected/e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b-kube-api-access-rnhpb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-7sk9r\" (UID: \"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.304971 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.304908 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:52.437863 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.437838 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r"] May 28 18:35:52.439580 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:52.439548 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34f0aeb_93d8_4bfa_8f2a_d5b3c34be21b.slice/crio-f1d36843242b02eeab5d0a5aa86a099aa9a5a241510baf082adf2d685c8a39e8 WatchSource:0}: Error finding container f1d36843242b02eeab5d0a5aa86a099aa9a5a241510baf082adf2d685c8a39e8: Status 404 returned error can't find the container with id f1d36843242b02eeab5d0a5aa86a099aa9a5a241510baf082adf2d685c8a39e8 May 28 18:35:52.441756 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.441723 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 18:35:52.441879 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.441784 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 18:35:52.441879 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.441814 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 18:35:52.903723 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.903683 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" event={"ID":"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b","Type":"ContainerStarted","Data":"001679f9ac18c8cbd2886c6c8280e3d67c36cd5564daa40bd424d4926d08c66b"} May 28 18:35:52.903723 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.903728 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" event={"ID":"e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b","Type":"ContainerStarted","Data":"f1d36843242b02eeab5d0a5aa86a099aa9a5a241510baf082adf2d685c8a39e8"} May 28 18:35:52.922753 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:52.922707 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" podStartSLOduration=1.922694041 podStartE2EDuration="1.922694041s" podCreationTimestamp="2026-05-28 18:35:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:52.920663003 +0000 UTC m=+592.594798642" watchObservedRunningTime="2026-05-28 18:35:52.922694041 +0000 UTC m=+592.596829653" May 28 18:35:53.305421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:53.305340 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:53.310167 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:53.310145 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:53.907548 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:53.907513 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:53.908337 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:53.908317 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-7sk9r" May 28 18:35:56.055413 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.055380 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:35:56.058612 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.058596 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.061052 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.061031 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7tjc6\"" May 28 18:35:56.061146 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.061031 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 18:35:56.065316 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.065293 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:35:56.121775 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.121740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-config-file\") pod \"limitador-limitador-7d549b5b-4ljnw\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.121914 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.121839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmld\" (UniqueName: \"kubernetes.io/projected/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-kube-api-access-jmmld\") pod \"limitador-limitador-7d549b5b-4ljnw\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.158438 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.158404 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:35:56.222695 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.222657 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-config-file\") pod \"limitador-limitador-7d549b5b-4ljnw\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.222872 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.222738 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmld\" (UniqueName: \"kubernetes.io/projected/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-kube-api-access-jmmld\") pod \"limitador-limitador-7d549b5b-4ljnw\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.223301 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.223283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-config-file\") pod \"limitador-limitador-7d549b5b-4ljnw\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.231195 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.231175 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmld\" (UniqueName: \"kubernetes.io/projected/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-kube-api-access-jmmld\") pod \"limitador-limitador-7d549b5b-4ljnw\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.370567 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.370471 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:56.497800 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.497771 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:35:56.499733 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:56.499701 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205bbdae_6ae5_4bbd_853f_a3e0ae8d2783.slice/crio-053cf311d9b00199bf8db6012306acc0a0e6c57d50322f3d0fea2c93fec2cf8c WatchSource:0}: Error finding container 053cf311d9b00199bf8db6012306acc0a0e6c57d50322f3d0fea2c93fec2cf8c: Status 404 returned error can't find the container with id 053cf311d9b00199bf8db6012306acc0a0e6c57d50322f3d0fea2c93fec2cf8c May 28 18:35:56.887184 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.887152 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-fcsbc"] May 28 18:35:56.890949 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.890922 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:35:56.894838 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.894631 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nnwdw\"" May 28 18:35:56.896931 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.896888 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-fcsbc"] May 28 18:35:56.921045 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.921007 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" event={"ID":"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783","Type":"ContainerStarted","Data":"053cf311d9b00199bf8db6012306acc0a0e6c57d50322f3d0fea2c93fec2cf8c"} May 28 18:35:56.929928 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:56.928664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pts28\" (UniqueName: \"kubernetes.io/projected/ef8ebee2-ad82-4326-af66-70ad561a54d6-kube-api-access-pts28\") pod \"authorino-f99f4b5cd-fcsbc\" (UID: \"ef8ebee2-ad82-4326-af66-70ad561a54d6\") " pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:35:57.030133 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:57.030089 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pts28\" (UniqueName: \"kubernetes.io/projected/ef8ebee2-ad82-4326-af66-70ad561a54d6-kube-api-access-pts28\") pod \"authorino-f99f4b5cd-fcsbc\" (UID: \"ef8ebee2-ad82-4326-af66-70ad561a54d6\") " pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:35:57.042161 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:57.041489 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pts28\" (UniqueName: \"kubernetes.io/projected/ef8ebee2-ad82-4326-af66-70ad561a54d6-kube-api-access-pts28\") pod \"authorino-f99f4b5cd-fcsbc\" (UID: \"ef8ebee2-ad82-4326-af66-70ad561a54d6\") " pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:35:57.204433 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:57.204395 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:35:57.358853 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:57.358827 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-fcsbc"] May 28 18:35:57.360432 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:35:57.360381 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef8ebee2_ad82_4326_af66_70ad561a54d6.slice/crio-23b16627539a8e981628007215e37900885f9696a1bf0366111b3d9d9f4fd32a WatchSource:0}: Error finding container 23b16627539a8e981628007215e37900885f9696a1bf0366111b3d9d9f4fd32a: Status 404 returned error can't find the container with id 23b16627539a8e981628007215e37900885f9696a1bf0366111b3d9d9f4fd32a May 28 18:35:57.926736 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:57.926688 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" event={"ID":"ef8ebee2-ad82-4326-af66-70ad561a54d6","Type":"ContainerStarted","Data":"23b16627539a8e981628007215e37900885f9696a1bf0366111b3d9d9f4fd32a"} May 28 18:35:59.937010 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:59.936971 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" event={"ID":"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783","Type":"ContainerStarted","Data":"36ec29695c38b572cc95f8c92c68916f9e63e5b30dca7e60352d3b8791abc9b8"} May 28 18:35:59.937425 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:59.937155 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:35:59.953263 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:35:59.953210 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" podStartSLOduration=1.46893552 podStartE2EDuration="3.953194518s" podCreationTimestamp="2026-05-28 18:35:56 +0000 UTC" firstStartedPulling="2026-05-28 18:35:56.502031398 +0000 UTC m=+596.176166991" lastFinishedPulling="2026-05-28 18:35:58.986290392 +0000 UTC m=+598.660425989" observedRunningTime="2026-05-28 18:35:59.951923461 +0000 UTC m=+599.626059077" watchObservedRunningTime="2026-05-28 18:35:59.953194518 +0000 UTC m=+599.627330134" May 28 18:36:00.845097 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:00.845067 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-fcsbc"] May 28 18:36:01.281443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:01.281411 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:36:01.281443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:01.281424 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:36:01.945724 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:01.945685 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" event={"ID":"ef8ebee2-ad82-4326-af66-70ad561a54d6","Type":"ContainerStarted","Data":"1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2"} May 28 18:36:01.945918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:01.945706 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" podUID="ef8ebee2-ad82-4326-af66-70ad561a54d6" containerName="authorino" containerID="cri-o://1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2" gracePeriod=30 May 28 18:36:01.959232 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:01.959187 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" podStartSLOduration=2.008561175 podStartE2EDuration="5.959173675s" podCreationTimestamp="2026-05-28 18:35:56 +0000 UTC" firstStartedPulling="2026-05-28 18:35:57.361850148 +0000 UTC m=+597.035985744" lastFinishedPulling="2026-05-28 18:36:01.312462638 +0000 UTC m=+600.986598244" observedRunningTime="2026-05-28 18:36:01.957716542 +0000 UTC m=+601.631852152" watchObservedRunningTime="2026-05-28 18:36:01.959173675 +0000 UTC m=+601.633309289" May 28 18:36:02.198555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.198480 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:36:02.279683 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.279658 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pts28\" (UniqueName: \"kubernetes.io/projected/ef8ebee2-ad82-4326-af66-70ad561a54d6-kube-api-access-pts28\") pod \"ef8ebee2-ad82-4326-af66-70ad561a54d6\" (UID: \"ef8ebee2-ad82-4326-af66-70ad561a54d6\") " May 28 18:36:02.281616 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.281591 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8ebee2-ad82-4326-af66-70ad561a54d6-kube-api-access-pts28" (OuterVolumeSpecName: "kube-api-access-pts28") pod "ef8ebee2-ad82-4326-af66-70ad561a54d6" (UID: "ef8ebee2-ad82-4326-af66-70ad561a54d6"). InnerVolumeSpecName "kube-api-access-pts28". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:36:02.380238 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.380209 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pts28\" (UniqueName: \"kubernetes.io/projected/ef8ebee2-ad82-4326-af66-70ad561a54d6-kube-api-access-pts28\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:36:02.950047 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.950019 2559 generic.go:358] "Generic (PLEG): container finished" podID="ef8ebee2-ad82-4326-af66-70ad561a54d6" containerID="1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2" exitCode=0 May 28 18:36:02.950174 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.950064 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" event={"ID":"ef8ebee2-ad82-4326-af66-70ad561a54d6","Type":"ContainerDied","Data":"1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2"} May 28 18:36:02.950174 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.950084 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" event={"ID":"ef8ebee2-ad82-4326-af66-70ad561a54d6","Type":"ContainerDied","Data":"23b16627539a8e981628007215e37900885f9696a1bf0366111b3d9d9f4fd32a"} May 28 18:36:02.950174 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.950065 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-fcsbc" May 28 18:36:02.950174 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.950100 2559 scope.go:117] "RemoveContainer" containerID="1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2" May 28 18:36:02.958362 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.958347 2559 scope.go:117] "RemoveContainer" containerID="1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2" May 28 18:36:02.958634 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:36:02.958613 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2\": container with ID starting with 1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2 not found: ID does not exist" containerID="1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2" May 28 18:36:02.958728 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.958638 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2"} err="failed to get container status \"1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2\": rpc error: code = NotFound desc = could not find container \"1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2\": container with ID starting with 1ddba5f538d0e1938e05d7d957dfddfa03cc3d97754684d6750b54bdc864c2a2 not found: ID does not exist" May 28 18:36:02.965376 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.965351 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-fcsbc"] May 28 18:36:02.967747 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:02.967727 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-fcsbc"] May 28 18:36:04.934075 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:04.934042 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8ebee2-ad82-4326-af66-70ad561a54d6" path="/var/lib/kubelet/pods/ef8ebee2-ad82-4326-af66-70ad561a54d6/volumes" May 28 18:36:10.508572 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:10.508523 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:36:10.509063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:10.508826 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" podUID="205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" containerName="limitador" containerID="cri-o://36ec29695c38b572cc95f8c92c68916f9e63e5b30dca7e60352d3b8791abc9b8" gracePeriod=30 May 28 18:36:10.509496 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:10.509440 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:36:10.982213 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:10.982179 2559 generic.go:358] "Generic (PLEG): container finished" podID="205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" containerID="36ec29695c38b572cc95f8c92c68916f9e63e5b30dca7e60352d3b8791abc9b8" exitCode=0 May 28 18:36:10.982362 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:10.982236 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" event={"ID":"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783","Type":"ContainerDied","Data":"36ec29695c38b572cc95f8c92c68916f9e63e5b30dca7e60352d3b8791abc9b8"} May 28 18:36:11.063932 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.063909 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:36:11.151255 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.151231 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-config-file\") pod \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " May 28 18:36:11.151388 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.151300 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmmld\" (UniqueName: \"kubernetes.io/projected/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-kube-api-access-jmmld\") pod \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\" (UID: \"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783\") " May 28 18:36:11.151597 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.151576 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-config-file" (OuterVolumeSpecName: "config-file") pod "205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" (UID: "205bbdae-6ae5-4bbd-853f-a3e0ae8d2783"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 18:36:11.153233 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.153208 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-kube-api-access-jmmld" (OuterVolumeSpecName: "kube-api-access-jmmld") pod "205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" (UID: "205bbdae-6ae5-4bbd-853f-a3e0ae8d2783"). InnerVolumeSpecName "kube-api-access-jmmld". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:36:11.252277 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.252248 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmmld\" (UniqueName: \"kubernetes.io/projected/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-kube-api-access-jmmld\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:36:11.252277 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.252273 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783-config-file\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:36:11.987074 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.987042 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" May 28 18:36:11.987074 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.987060 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-4ljnw" event={"ID":"205bbdae-6ae5-4bbd-853f-a3e0ae8d2783","Type":"ContainerDied","Data":"053cf311d9b00199bf8db6012306acc0a0e6c57d50322f3d0fea2c93fec2cf8c"} May 28 18:36:11.987555 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:11.987104 2559 scope.go:117] "RemoveContainer" containerID="36ec29695c38b572cc95f8c92c68916f9e63e5b30dca7e60352d3b8791abc9b8" May 28 18:36:12.014616 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.014584 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:36:12.019180 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.019157 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-4ljnw"] May 28 18:36:12.066743 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.066715 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-f9kzk"] May 28 18:36:12.067246 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.067228 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8ebee2-ad82-4326-af66-70ad561a54d6" containerName="authorino" May 28 18:36:12.067293 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.067252 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8ebee2-ad82-4326-af66-70ad561a54d6" containerName="authorino" May 28 18:36:12.067293 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.067266 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" containerName="limitador" May 28 18:36:12.067293 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.067275 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" containerName="limitador" May 28 18:36:12.067386 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.067374 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" containerName="limitador" May 28 18:36:12.067419 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.067390 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef8ebee2-ad82-4326-af66-70ad561a54d6" containerName="authorino" May 28 18:36:12.072288 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.072263 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.075457 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.075437 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 28 18:36:12.076226 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.076208 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zcj2w\"" May 28 18:36:12.080406 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.080383 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-f9kzk"] May 28 18:36:12.159952 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.159923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aae6219e-2389-4470-8d8f-35705cd5c008-data\") pod \"postgres-68c4fbbd6f-f9kzk\" (UID: \"aae6219e-2389-4470-8d8f-35705cd5c008\") " pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.160069 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.159989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rjxz\" (UniqueName: \"kubernetes.io/projected/aae6219e-2389-4470-8d8f-35705cd5c008-kube-api-access-4rjxz\") pod \"postgres-68c4fbbd6f-f9kzk\" (UID: \"aae6219e-2389-4470-8d8f-35705cd5c008\") " pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.260471 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.260399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rjxz\" (UniqueName: \"kubernetes.io/projected/aae6219e-2389-4470-8d8f-35705cd5c008-kube-api-access-4rjxz\") pod \"postgres-68c4fbbd6f-f9kzk\" (UID: \"aae6219e-2389-4470-8d8f-35705cd5c008\") " pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.260633 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.260482 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aae6219e-2389-4470-8d8f-35705cd5c008-data\") pod \"postgres-68c4fbbd6f-f9kzk\" (UID: \"aae6219e-2389-4470-8d8f-35705cd5c008\") " pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.260863 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.260842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aae6219e-2389-4470-8d8f-35705cd5c008-data\") pod \"postgres-68c4fbbd6f-f9kzk\" (UID: \"aae6219e-2389-4470-8d8f-35705cd5c008\") " pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.268122 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.268096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rjxz\" (UniqueName: \"kubernetes.io/projected/aae6219e-2389-4470-8d8f-35705cd5c008-kube-api-access-4rjxz\") pod \"postgres-68c4fbbd6f-f9kzk\" (UID: \"aae6219e-2389-4470-8d8f-35705cd5c008\") " pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.384901 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.384868 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:12.506448 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.506425 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-f9kzk"] May 28 18:36:12.507846 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:36:12.507817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae6219e_2389_4470_8d8f_35705cd5c008.slice/crio-8df625419242f65dfa935688057f5f0b58edefe0a1decffd9440ab2da6cbfdf5 WatchSource:0}: Error finding container 8df625419242f65dfa935688057f5f0b58edefe0a1decffd9440ab2da6cbfdf5: Status 404 returned error can't find the container with id 8df625419242f65dfa935688057f5f0b58edefe0a1decffd9440ab2da6cbfdf5 May 28 18:36:12.934011 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.933984 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205bbdae-6ae5-4bbd-853f-a3e0ae8d2783" path="/var/lib/kubelet/pods/205bbdae-6ae5-4bbd-853f-a3e0ae8d2783/volumes" May 28 18:36:12.991512 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:12.991472 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" event={"ID":"aae6219e-2389-4470-8d8f-35705cd5c008","Type":"ContainerStarted","Data":"8df625419242f65dfa935688057f5f0b58edefe0a1decffd9440ab2da6cbfdf5"} May 28 18:36:22.029140 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:22.029100 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" event={"ID":"aae6219e-2389-4470-8d8f-35705cd5c008","Type":"ContainerStarted","Data":"1e05fdf97507209238782a46a3f15bb4d215b43bc07d4c42f07b3650b260f792"} May 28 18:36:22.029603 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:22.029232 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:22.044006 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:22.043949 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" podStartSLOduration=1.287771312 podStartE2EDuration="10.043933991s" podCreationTimestamp="2026-05-28 18:36:12 +0000 UTC" firstStartedPulling="2026-05-28 18:36:12.509086082 +0000 UTC m=+612.183221674" lastFinishedPulling="2026-05-28 18:36:21.265248761 +0000 UTC m=+620.939384353" observedRunningTime="2026-05-28 18:36:22.043220484 +0000 UTC m=+621.717356102" watchObservedRunningTime="2026-05-28 18:36:22.043933991 +0000 UTC m=+621.718069607" May 28 18:36:28.061388 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.061355 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-f9kzk" May 28 18:36:28.572106 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.572073 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-m8rdz"] May 28 18:36:28.578184 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.578160 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:28.580893 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.580866 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nnwdw\"" May 28 18:36:28.581915 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.581889 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-m8rdz"] May 28 18:36:28.601486 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.601460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-728lq\" (UniqueName: \"kubernetes.io/projected/6896545a-aebc-4dc7-8bad-eed42780a1a5-kube-api-access-728lq\") pod \"authorino-8b475cf9f-m8rdz\" (UID: \"6896545a-aebc-4dc7-8bad-eed42780a1a5\") " pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:28.702498 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.702463 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-728lq\" (UniqueName: \"kubernetes.io/projected/6896545a-aebc-4dc7-8bad-eed42780a1a5-kube-api-access-728lq\") pod \"authorino-8b475cf9f-m8rdz\" (UID: \"6896545a-aebc-4dc7-8bad-eed42780a1a5\") " pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:28.710776 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.710751 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-728lq\" (UniqueName: \"kubernetes.io/projected/6896545a-aebc-4dc7-8bad-eed42780a1a5-kube-api-access-728lq\") pod \"authorino-8b475cf9f-m8rdz\" (UID: \"6896545a-aebc-4dc7-8bad-eed42780a1a5\") " pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:28.798812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.798778 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-m8rdz"] May 28 18:36:28.799045 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.799033 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:28.826319 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.826243 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c45ddf945-74c56"] May 28 18:36:28.833136 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.833104 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c45ddf945-74c56"] May 28 18:36:28.833252 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.833213 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:28.904220 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.904191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2dr\" (UniqueName: \"kubernetes.io/projected/8f7a853d-d7a8-4175-b09b-de90fb9a86cb-kube-api-access-bq2dr\") pod \"authorino-7c45ddf945-74c56\" (UID: \"8f7a853d-d7a8-4175-b09b-de90fb9a86cb\") " pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:28.936161 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:36:28.936120 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6896545a_aebc_4dc7_8bad_eed42780a1a5.slice/crio-3619ff735c756fdbe202e9a096edf86fd70ad0e5e4cfcb65f0956d87efd406b2 WatchSource:0}: Error finding container 3619ff735c756fdbe202e9a096edf86fd70ad0e5e4cfcb65f0956d87efd406b2: Status 404 returned error can't find the container with id 3619ff735c756fdbe202e9a096edf86fd70ad0e5e4cfcb65f0956d87efd406b2 May 28 18:36:28.937451 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.937401 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-m8rdz"] May 28 18:36:28.944702 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:28.944454 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c45ddf945-74c56"] May 28 18:36:28.944876 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:36:28.944846 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bq2dr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7c45ddf945-74c56" podUID="8f7a853d-d7a8-4175-b09b-de90fb9a86cb" May 28 18:36:29.005226 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.005197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2dr\" (UniqueName: \"kubernetes.io/projected/8f7a853d-d7a8-4175-b09b-de90fb9a86cb-kube-api-access-bq2dr\") pod \"authorino-7c45ddf945-74c56\" (UID: \"8f7a853d-d7a8-4175-b09b-de90fb9a86cb\") " pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:29.012797 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.012771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2dr\" (UniqueName: \"kubernetes.io/projected/8f7a853d-d7a8-4175-b09b-de90fb9a86cb-kube-api-access-bq2dr\") pod \"authorino-7c45ddf945-74c56\" (UID: \"8f7a853d-d7a8-4175-b09b-de90fb9a86cb\") " pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:29.053891 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.053866 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" event={"ID":"6896545a-aebc-4dc7-8bad-eed42780a1a5","Type":"ContainerStarted","Data":"3619ff735c756fdbe202e9a096edf86fd70ad0e5e4cfcb65f0956d87efd406b2"} May 28 18:36:29.054010 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.053925 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:29.058750 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.058734 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:29.105889 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.105820 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq2dr\" (UniqueName: \"kubernetes.io/projected/8f7a853d-d7a8-4175-b09b-de90fb9a86cb-kube-api-access-bq2dr\") pod \"8f7a853d-d7a8-4175-b09b-de90fb9a86cb\" (UID: \"8f7a853d-d7a8-4175-b09b-de90fb9a86cb\") " May 28 18:36:29.107839 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.107815 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7a853d-d7a8-4175-b09b-de90fb9a86cb-kube-api-access-bq2dr" (OuterVolumeSpecName: "kube-api-access-bq2dr") pod "8f7a853d-d7a8-4175-b09b-de90fb9a86cb" (UID: "8f7a853d-d7a8-4175-b09b-de90fb9a86cb"). InnerVolumeSpecName "kube-api-access-bq2dr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:36:29.206495 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:29.206461 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq2dr\" (UniqueName: \"kubernetes.io/projected/8f7a853d-d7a8-4175-b09b-de90fb9a86cb-kube-api-access-bq2dr\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:36:30.059118 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.059025 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" event={"ID":"6896545a-aebc-4dc7-8bad-eed42780a1a5","Type":"ContainerStarted","Data":"5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3"} May 28 18:36:30.059118 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.059047 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" podUID="6896545a-aebc-4dc7-8bad-eed42780a1a5" containerName="authorino" containerID="cri-o://5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3" gracePeriod=30 May 28 18:36:30.059331 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.059065 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c45ddf945-74c56" May 28 18:36:30.073767 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.073728 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" podStartSLOduration=1.746167925 podStartE2EDuration="2.073716501s" podCreationTimestamp="2026-05-28 18:36:28 +0000 UTC" firstStartedPulling="2026-05-28 18:36:28.937124923 +0000 UTC m=+628.611260533" lastFinishedPulling="2026-05-28 18:36:29.264673514 +0000 UTC m=+628.938809109" observedRunningTime="2026-05-28 18:36:30.071846617 +0000 UTC m=+629.745982234" watchObservedRunningTime="2026-05-28 18:36:30.073716501 +0000 UTC m=+629.747852116" May 28 18:36:30.080281 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:36:30.080254 2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f7a853d_d7a8_4175_b09b_de90fb9a86cb.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6896545a_aebc_4dc7_8bad_eed42780a1a5.slice/crio-conmon-5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3.scope\": RecentStats: unable to find data in memory cache]" May 28 18:36:30.093843 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.093819 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c45ddf945-74c56"] May 28 18:36:30.097497 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.097473 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c45ddf945-74c56"] May 28 18:36:30.307043 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.307020 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:30.316622 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.316576 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-728lq\" (UniqueName: \"kubernetes.io/projected/6896545a-aebc-4dc7-8bad-eed42780a1a5-kube-api-access-728lq\") pod \"6896545a-aebc-4dc7-8bad-eed42780a1a5\" (UID: \"6896545a-aebc-4dc7-8bad-eed42780a1a5\") " May 28 18:36:30.318725 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.318701 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6896545a-aebc-4dc7-8bad-eed42780a1a5-kube-api-access-728lq" (OuterVolumeSpecName: "kube-api-access-728lq") pod "6896545a-aebc-4dc7-8bad-eed42780a1a5" (UID: "6896545a-aebc-4dc7-8bad-eed42780a1a5"). InnerVolumeSpecName "kube-api-access-728lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 18:36:30.417255 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.417225 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-728lq\" (UniqueName: \"kubernetes.io/projected/6896545a-aebc-4dc7-8bad-eed42780a1a5-kube-api-access-728lq\") on node \"ip-10-0-140-205.ec2.internal\" DevicePath \"\"" May 28 18:36:30.936020 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:30.935987 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f7a853d-d7a8-4175-b09b-de90fb9a86cb" path="/var/lib/kubelet/pods/8f7a853d-d7a8-4175-b09b-de90fb9a86cb/volumes" May 28 18:36:31.062983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.062941 2559 generic.go:358] "Generic (PLEG): container finished" podID="6896545a-aebc-4dc7-8bad-eed42780a1a5" containerID="5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3" exitCode=0 May 28 18:36:31.063165 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.062996 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" May 28 18:36:31.063165 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.063050 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" event={"ID":"6896545a-aebc-4dc7-8bad-eed42780a1a5","Type":"ContainerDied","Data":"5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3"} May 28 18:36:31.063165 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.063098 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-m8rdz" event={"ID":"6896545a-aebc-4dc7-8bad-eed42780a1a5","Type":"ContainerDied","Data":"3619ff735c756fdbe202e9a096edf86fd70ad0e5e4cfcb65f0956d87efd406b2"} May 28 18:36:31.063165 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.063119 2559 scope.go:117] "RemoveContainer" containerID="5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3" May 28 18:36:31.071311 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.071293 2559 scope.go:117] "RemoveContainer" containerID="5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3" May 28 18:36:31.071567 ip-10-0-140-205 kubenswrapper[2559]: E0528 18:36:31.071529 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3\": container with ID starting with 5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3 not found: ID does not exist" containerID="5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3" May 28 18:36:31.071624 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.071575 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3"} err="failed to get container status \"5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3\": rpc error: code = NotFound desc = could not find container \"5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3\": container with ID starting with 5ab038fce4c2bd336b05a119d0ba21f7b3edf95437dae70c5b7eebb1a400b6f3 not found: ID does not exist" May 28 18:36:31.078607 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.078587 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-m8rdz"] May 28 18:36:31.081713 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:31.081694 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-m8rdz"] May 28 18:36:32.934271 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:36:32.934241 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6896545a-aebc-4dc7-8bad-eed42780a1a5" path="/var/lib/kubelet/pods/6896545a-aebc-4dc7-8bad-eed42780a1a5/volumes" May 28 18:37:10.512836 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.512798 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qzxl2"] May 28 18:37:10.513233 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.513149 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6896545a-aebc-4dc7-8bad-eed42780a1a5" containerName="authorino" May 28 18:37:10.513233 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.513160 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6896545a-aebc-4dc7-8bad-eed42780a1a5" containerName="authorino" May 28 18:37:10.513233 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.513212 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6896545a-aebc-4dc7-8bad-eed42780a1a5" containerName="authorino" May 28 18:37:10.516063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.516047 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:10.518545 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.518519 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 28 18:37:10.518708 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.518690 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s5xwr\"" May 28 18:37:10.526097 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.526074 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qzxl2"] May 28 18:37:10.673983 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.673953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7k6h\" (UniqueName: \"kubernetes.io/projected/3b4d256c-9414-476c-a009-f8eaf6a7672b-kube-api-access-t7k6h\") pod \"payload-processing-58b6c8fdc7-qzxl2\" (UID: \"3b4d256c-9414-476c-a009-f8eaf6a7672b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:10.774509 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.774415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7k6h\" (UniqueName: \"kubernetes.io/projected/3b4d256c-9414-476c-a009-f8eaf6a7672b-kube-api-access-t7k6h\") pod \"payload-processing-58b6c8fdc7-qzxl2\" (UID: \"3b4d256c-9414-476c-a009-f8eaf6a7672b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:10.781999 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.781966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7k6h\" (UniqueName: \"kubernetes.io/projected/3b4d256c-9414-476c-a009-f8eaf6a7672b-kube-api-access-t7k6h\") pod \"payload-processing-58b6c8fdc7-qzxl2\" (UID: \"3b4d256c-9414-476c-a009-f8eaf6a7672b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:10.827312 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.827276 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:10.959495 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.959470 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qzxl2"] May 28 18:37:10.961126 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:37:10.961082 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4d256c_9414_476c_a009_f8eaf6a7672b.slice/crio-123e532d2e64e9ef64837e882b6a8be6e298e2550bea84f0b0ebf2966b281ef0 WatchSource:0}: Error finding container 123e532d2e64e9ef64837e882b6a8be6e298e2550bea84f0b0ebf2966b281ef0: Status 404 returned error can't find the container with id 123e532d2e64e9ef64837e882b6a8be6e298e2550bea84f0b0ebf2966b281ef0 May 28 18:37:10.963107 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:10.963084 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:37:11.215520 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:11.215484 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" event={"ID":"3b4d256c-9414-476c-a009-f8eaf6a7672b","Type":"ContainerStarted","Data":"123e532d2e64e9ef64837e882b6a8be6e298e2550bea84f0b0ebf2966b281ef0"} May 28 18:37:14.229285 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:14.229249 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" event={"ID":"3b4d256c-9414-476c-a009-f8eaf6a7672b","Type":"ContainerStarted","Data":"77796637633c1d4315877b6fbe74976a4f075846a83ba9854d1758d9e992014a"} May 28 18:37:14.229705 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:14.229351 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:14.245945 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:14.245892 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" podStartSLOduration=1.688106002 podStartE2EDuration="4.24587941s" podCreationTimestamp="2026-05-28 18:37:10 +0000 UTC" firstStartedPulling="2026-05-28 18:37:10.963274449 +0000 UTC m=+670.637410045" lastFinishedPulling="2026-05-28 18:37:13.521047857 +0000 UTC m=+673.195183453" observedRunningTime="2026-05-28 18:37:14.243091166 +0000 UTC m=+673.917226780" watchObservedRunningTime="2026-05-28 18:37:14.24587941 +0000 UTC m=+673.920015025" May 28 18:37:25.235556 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:25.235510 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzxl2" May 28 18:37:52.383051 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.382972 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl"] May 28 18:37:52.385338 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.385323 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.388965 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.388939 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 28 18:37:52.389101 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.389035 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 28 18:37:52.389176 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.389097 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qms9\"" May 28 18:37:52.389176 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.389040 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 28 18:37:52.397145 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.397117 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl"] May 28 18:37:52.539798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.539767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.539798 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.539804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.539992 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.539825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.539992 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.539898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84a4ec24-c9fe-422f-9be7-85f198c4388c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.539992 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.539932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zknwt\" (UniqueName: \"kubernetes.io/projected/84a4ec24-c9fe-422f-9be7-85f198c4388c-kube-api-access-zknwt\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.539992 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.539965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641336 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84a4ec24-c9fe-422f-9be7-85f198c4388c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641336 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641299 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zknwt\" (UniqueName: \"kubernetes.io/projected/84a4ec24-c9fe-422f-9be7-85f198c4388c-kube-api-access-zknwt\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641507 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641407 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641507 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641464 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641507 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641488 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641659 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641512 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641864 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.641896 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.642036 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.641931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.643602 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.643580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84a4ec24-c9fe-422f-9be7-85f198c4388c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.643953 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.643934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84a4ec24-c9fe-422f-9be7-85f198c4388c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.648657 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.648638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zknwt\" (UniqueName: \"kubernetes.io/projected/84a4ec24-c9fe-422f-9be7-85f198c4388c-kube-api-access-zknwt\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-9thvl\" (UID: \"84a4ec24-c9fe-422f-9be7-85f198c4388c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.697556 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.697504 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:37:52.826224 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:52.826198 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl"] May 28 18:37:52.827378 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:37:52.827351 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a4ec24_c9fe_422f_9be7_85f198c4388c.slice/crio-c2d2aa8f01979b0c38e4f2e8aba4b8d59cca6479051a542cfb5e05cbf30e98a1 WatchSource:0}: Error finding container c2d2aa8f01979b0c38e4f2e8aba4b8d59cca6479051a542cfb5e05cbf30e98a1: Status 404 returned error can't find the container with id c2d2aa8f01979b0c38e4f2e8aba4b8d59cca6479051a542cfb5e05cbf30e98a1 May 28 18:37:53.374255 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:53.374214 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" event={"ID":"84a4ec24-c9fe-422f-9be7-85f198c4388c","Type":"ContainerStarted","Data":"c2d2aa8f01979b0c38e4f2e8aba4b8d59cca6479051a542cfb5e05cbf30e98a1"} May 28 18:37:59.400661 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:37:59.400618 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" event={"ID":"84a4ec24-c9fe-422f-9be7-85f198c4388c","Type":"ContainerStarted","Data":"aee95adb819914a97292df506045125f81b47365e755e3daa11b5170b7e695f1"} May 28 18:38:04.419871 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:04.419835 2559 generic.go:358] "Generic (PLEG): container finished" podID="84a4ec24-c9fe-422f-9be7-85f198c4388c" containerID="aee95adb819914a97292df506045125f81b47365e755e3daa11b5170b7e695f1" exitCode=0 May 28 18:38:04.420284 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:04.419922 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" event={"ID":"84a4ec24-c9fe-422f-9be7-85f198c4388c","Type":"ContainerDied","Data":"aee95adb819914a97292df506045125f81b47365e755e3daa11b5170b7e695f1"} May 28 18:38:06.429021 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:06.428975 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" event={"ID":"84a4ec24-c9fe-422f-9be7-85f198c4388c","Type":"ContainerStarted","Data":"a8691a5b6cc524ee46b6d2d0865c0c766e04d17ca1d77145c04e25eca8b3e718"} May 28 18:38:06.429451 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:06.429315 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:38:06.447781 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:06.447728 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" podStartSLOduration=1.6994211909999999 podStartE2EDuration="14.447714375s" podCreationTimestamp="2026-05-28 18:37:52 +0000 UTC" firstStartedPulling="2026-05-28 18:37:52.829166764 +0000 UTC m=+712.503302357" lastFinishedPulling="2026-05-28 18:38:05.577459945 +0000 UTC m=+725.251595541" observedRunningTime="2026-05-28 18:38:06.44562661 +0000 UTC m=+726.119762221" watchObservedRunningTime="2026-05-28 18:38:06.447714375 +0000 UTC m=+726.121850046" May 28 18:38:13.785612 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.785570 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss"] May 28 18:38:13.792864 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.792768 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.795278 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.795256 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 28 18:38:13.796228 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.796205 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss"] May 28 18:38:13.839871 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.839843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.839984 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.839880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.839984 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.839901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.839984 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.839940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gmsw\" (UniqueName: \"kubernetes.io/projected/f0784109-0bc1-4813-8040-082551657680-kube-api-access-8gmsw\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.840096 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.839982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.840096 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.840015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0784109-0bc1-4813-8040-082551657680-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941225 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gmsw\" (UniqueName: \"kubernetes.io/projected/f0784109-0bc1-4813-8040-082551657680-kube-api-access-8gmsw\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941225 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941228 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941246 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0784109-0bc1-4813-8040-082551657680-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941308 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941330 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941443 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941354 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941686 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941758 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.941812 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.941745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.943650 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.943630 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0784109-0bc1-4813-8040-082551657680-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.943790 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.943772 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0784109-0bc1-4813-8040-082551657680-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:13.948531 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:13.948511 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gmsw\" (UniqueName: \"kubernetes.io/projected/f0784109-0bc1-4813-8040-082551657680-kube-api-access-8gmsw\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss\" (UID: \"f0784109-0bc1-4813-8040-082551657680\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:14.104578 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:14.104471 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:14.234485 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:14.234461 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss"] May 28 18:38:14.236239 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:38:14.236208 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0784109_0bc1_4813_8040_082551657680.slice/crio-cd096a204f529ba3ad5a3fb5c775459d338acefe62d67a1c4bcd00c977b74515 WatchSource:0}: Error finding container cd096a204f529ba3ad5a3fb5c775459d338acefe62d67a1c4bcd00c977b74515: Status 404 returned error can't find the container with id cd096a204f529ba3ad5a3fb5c775459d338acefe62d67a1c4bcd00c977b74515 May 28 18:38:14.461235 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:14.461199 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" event={"ID":"f0784109-0bc1-4813-8040-082551657680","Type":"ContainerStarted","Data":"269e113ec44c6041f1a22fe6041443c7fb1b539307657e7fed9c437cda37e2ec"} May 28 18:38:14.461235 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:14.461234 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" event={"ID":"f0784109-0bc1-4813-8040-082551657680","Type":"ContainerStarted","Data":"cd096a204f529ba3ad5a3fb5c775459d338acefe62d67a1c4bcd00c977b74515"} May 28 18:38:17.446971 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:17.446937 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-9thvl" May 28 18:38:20.485293 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:20.485258 2559 generic.go:358] "Generic (PLEG): container finished" podID="f0784109-0bc1-4813-8040-082551657680" containerID="269e113ec44c6041f1a22fe6041443c7fb1b539307657e7fed9c437cda37e2ec" exitCode=0 May 28 18:38:20.485672 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:20.485293 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" event={"ID":"f0784109-0bc1-4813-8040-082551657680","Type":"ContainerDied","Data":"269e113ec44c6041f1a22fe6041443c7fb1b539307657e7fed9c437cda37e2ec"} May 28 18:38:21.490824 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:21.490790 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" event={"ID":"f0784109-0bc1-4813-8040-082551657680","Type":"ContainerStarted","Data":"15e4dad90034d6c58acc5e694ca8b8434b41542f55ba0145412e877333481997"} May 28 18:38:21.491189 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:21.490997 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:38:21.509924 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:21.509880 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" podStartSLOduration=7.961388269 podStartE2EDuration="8.509868309s" podCreationTimestamp="2026-05-28 18:38:13 +0000 UTC" firstStartedPulling="2026-05-28 18:38:20.48591313 +0000 UTC m=+740.160048723" lastFinishedPulling="2026-05-28 18:38:21.034393159 +0000 UTC m=+740.708528763" observedRunningTime="2026-05-28 18:38:21.507392605 +0000 UTC m=+741.181528236" watchObservedRunningTime="2026-05-28 18:38:21.509868309 +0000 UTC m=+741.184003952" May 28 18:38:32.509063 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:38:32.509031 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss" May 28 18:39:12.530068 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.530036 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67bb7f57c6-7xkkx"] May 28 18:39:12.532863 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.532839 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.536276 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.536259 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nnwdw\"" May 28 18:39:12.536377 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.536281 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 28 18:39:12.540411 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.540388 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67bb7f57c6-7xkkx"] May 28 18:39:12.656432 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.656400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c5d5ea8-991b-4949-86bd-5111c078555c-tls-cert\") pod \"authorino-67bb7f57c6-7xkkx\" (UID: \"8c5d5ea8-991b-4949-86bd-5111c078555c\") " pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.656584 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.656455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrkc\" (UniqueName: \"kubernetes.io/projected/8c5d5ea8-991b-4949-86bd-5111c078555c-kube-api-access-qsrkc\") pod \"authorino-67bb7f57c6-7xkkx\" (UID: \"8c5d5ea8-991b-4949-86bd-5111c078555c\") " pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.757918 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.757892 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c5d5ea8-991b-4949-86bd-5111c078555c-tls-cert\") pod \"authorino-67bb7f57c6-7xkkx\" (UID: \"8c5d5ea8-991b-4949-86bd-5111c078555c\") " pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.758055 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.757949 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrkc\" (UniqueName: \"kubernetes.io/projected/8c5d5ea8-991b-4949-86bd-5111c078555c-kube-api-access-qsrkc\") pod \"authorino-67bb7f57c6-7xkkx\" (UID: \"8c5d5ea8-991b-4949-86bd-5111c078555c\") " pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.760231 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.760201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c5d5ea8-991b-4949-86bd-5111c078555c-tls-cert\") pod \"authorino-67bb7f57c6-7xkkx\" (UID: \"8c5d5ea8-991b-4949-86bd-5111c078555c\") " pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.765172 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.765146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrkc\" (UniqueName: \"kubernetes.io/projected/8c5d5ea8-991b-4949-86bd-5111c078555c-kube-api-access-qsrkc\") pod \"authorino-67bb7f57c6-7xkkx\" (UID: \"8c5d5ea8-991b-4949-86bd-5111c078555c\") " pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.843325 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.843263 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" May 28 18:39:12.975419 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:12.975387 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67bb7f57c6-7xkkx"] May 28 18:39:12.977195 ip-10-0-140-205 kubenswrapper[2559]: W0528 18:39:12.977167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c5d5ea8_991b_4949_86bd_5111c078555c.slice/crio-5d967e7c564086f178228e78615560dbde2db4e06b65fd75fe47f254f23bae57 WatchSource:0}: Error finding container 5d967e7c564086f178228e78615560dbde2db4e06b65fd75fe47f254f23bae57: Status 404 returned error can't find the container with id 5d967e7c564086f178228e78615560dbde2db4e06b65fd75fe47f254f23bae57 May 28 18:39:13.679893 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:13.679849 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" event={"ID":"8c5d5ea8-991b-4949-86bd-5111c078555c","Type":"ContainerStarted","Data":"fd091599b43172e06ecec349b4fb405a97b1e1a1c60fe968923d311a4757c24c"} May 28 18:39:13.679893 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:13.679898 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" event={"ID":"8c5d5ea8-991b-4949-86bd-5111c078555c","Type":"ContainerStarted","Data":"5d967e7c564086f178228e78615560dbde2db4e06b65fd75fe47f254f23bae57"} May 28 18:39:13.695661 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:39:13.695603 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-67bb7f57c6-7xkkx" podStartSLOduration=1.359309583 podStartE2EDuration="1.695588259s" podCreationTimestamp="2026-05-28 18:39:12 +0000 UTC" firstStartedPulling="2026-05-28 18:39:12.978700958 +0000 UTC m=+792.652836550" lastFinishedPulling="2026-05-28 18:39:13.314979633 +0000 UTC m=+792.989115226" observedRunningTime="2026-05-28 18:39:13.694870734 +0000 UTC m=+793.369006348" watchObservedRunningTime="2026-05-28 18:39:13.695588259 +0000 UTC m=+793.369723874" May 28 18:41:01.312510 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:41:01.312479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:41:01.314486 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:41:01.314459 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:46:01.338138 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:46:01.338109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:46:01.341769 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:46:01.341742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:51:01.365102 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:51:01.365075 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:51:01.371146 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:51:01.371122 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:56:01.394421 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:56:01.394396 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 18:56:01.402338 ip-10-0-140-205 kubenswrapper[2559]: I0528 18:56:01.402316 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 19:01:01.434193 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:01:01.434165 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 19:01:01.440909 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:01:01.440882 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 19:02:13.749180 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:13.749147 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67bb7f57c6-7xkkx_8c5d5ea8-991b-4949-86bd-5111c078555c/authorino/0.log" May 28 19:02:19.011220 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.011190 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67686c6958-nbcmk_2e98f487-70c5-45f4-9535-b123f8a0f505/manager/0.log" May 28 19:02:19.120051 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.120028 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-f9kzk_aae6219e-2389-4470-8d8f-35705cd5c008/postgres/0.log" May 28 19:02:19.866773 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.866740 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9_967467fc-5961-4364-90c3-83484d4e8d5d/util/0.log" May 28 19:02:19.874291 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.874270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9_967467fc-5961-4364-90c3-83484d4e8d5d/pull/0.log" May 28 19:02:19.881026 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.881006 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9_967467fc-5961-4364-90c3-83484d4e8d5d/extract/0.log" May 28 19:02:19.988773 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.988744 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8_27097f19-4db6-44e4-bde1-5da2ba7f8262/util/0.log" May 28 19:02:19.995271 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:19.995247 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8_27097f19-4db6-44e4-bde1-5da2ba7f8262/pull/0.log" May 28 19:02:20.001081 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.001057 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8_27097f19-4db6-44e4-bde1-5da2ba7f8262/extract/0.log" May 28 19:02:20.109022 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.108989 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8_8cd6f33e-f987-428c-895c-6b35b6a23fa0/util/0.log" May 28 19:02:20.114937 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.114915 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8_8cd6f33e-f987-428c-895c-6b35b6a23fa0/pull/0.log" May 28 19:02:20.121075 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.121019 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8_8cd6f33e-f987-428c-895c-6b35b6a23fa0/extract/0.log" May 28 19:02:20.234073 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.234050 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn_c3923878-8776-42e4-809b-34c4e3ec2d37/util/0.log" May 28 19:02:20.241477 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.241457 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn_c3923878-8776-42e4-809b-34c4e3ec2d37/pull/0.log" May 28 19:02:20.247728 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.247706 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn_c3923878-8776-42e4-809b-34c4e3ec2d37/extract/0.log" May 28 19:02:20.358675 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.358650 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67bb7f57c6-7xkkx_8c5d5ea8-991b-4949-86bd-5111c078555c/authorino/0.log" May 28 19:02:20.480374 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.480344 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-9ggzc_e8524b7f-4d96-4630-a40b-05c29bec79e5/manager/0.log" May 28 19:02:20.810984 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:20.810913 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-554cn_c3240189-b454-439f-9e01-99101e4989bd/registry-server/0.log" May 28 19:02:21.500144 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:21.500117 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bb222k_839b5acb-58f7-4d0a-be95-ee3031f72b5d/istio-proxy/0.log" May 28 19:02:21.957248 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:21.957222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-7sk9r_e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b/istio-proxy/0.log" May 28 19:02:22.077468 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:22.077437 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-qzxl2_3b4d256c-9414-476c-a009-f8eaf6a7672b/payload-processing/0.log" May 28 19:02:22.187345 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:22.187319 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-89bfcb4fb-nzlzm_2ceb4be7-01b2-4f34-babf-c42b2a24931a/router/0.log" May 28 19:02:22.770135 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:22.770110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-9thvl_84a4ec24-c9fe-422f-9be7-85f198c4388c/storage-initializer/0.log" May 28 19:02:22.776957 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:22.776933 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-9thvl_84a4ec24-c9fe-422f-9be7-85f198c4388c/main/0.log" May 28 19:02:23.007055 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:23.007028 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss_f0784109-0bc1-4813-8040-082551657680/main/0.log" May 28 19:02:23.013196 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:23.013176 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-8l2ss_f0784109-0bc1-4813-8040-082551657680/storage-initializer/0.log" May 28 19:02:30.406097 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:30.406071 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w52xr_fa154587-a3d4-4522-92d9-24a4569ac5a1/global-pull-secret-syncer/0.log" May 28 19:02:30.465851 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:30.465825 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2s5fv_8694db8a-a823-46f9-9b48-40607fd63f11/konnectivity-agent/0.log" May 28 19:02:30.597056 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:30.597028 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-205.ec2.internal_273fe7d67b284666b129c476e57124bd/haproxy/0.log" May 28 19:02:34.411981 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.411952 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9_967467fc-5961-4364-90c3-83484d4e8d5d/extract/0.log" May 28 19:02:34.438158 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.438138 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9_967467fc-5961-4364-90c3-83484d4e8d5d/util/0.log" May 28 19:02:34.460642 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.460620 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql4p9_967467fc-5961-4364-90c3-83484d4e8d5d/pull/0.log" May 28 19:02:34.489233 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.489217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8_27097f19-4db6-44e4-bde1-5da2ba7f8262/extract/0.log" May 28 19:02:34.511189 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.511170 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8_27097f19-4db6-44e4-bde1-5da2ba7f8262/util/0.log" May 28 19:02:34.533066 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.533046 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fm2m8_27097f19-4db6-44e4-bde1-5da2ba7f8262/pull/0.log" May 28 19:02:34.558963 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.558944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8_8cd6f33e-f987-428c-895c-6b35b6a23fa0/extract/0.log" May 28 19:02:34.581129 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.581107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8_8cd6f33e-f987-428c-895c-6b35b6a23fa0/util/0.log" May 28 19:02:34.606659 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.606591 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736rjm8_8cd6f33e-f987-428c-895c-6b35b6a23fa0/pull/0.log" May 28 19:02:34.644178 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.644156 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn_c3923878-8776-42e4-809b-34c4e3ec2d37/extract/0.log" May 28 19:02:34.670260 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.670237 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn_c3923878-8776-42e4-809b-34c4e3ec2d37/util/0.log" May 28 19:02:34.694879 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.694860 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jr2gn_c3923878-8776-42e4-809b-34c4e3ec2d37/pull/0.log" May 28 19:02:34.882363 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.882282 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67bb7f57c6-7xkkx_8c5d5ea8-991b-4949-86bd-5111c078555c/authorino/0.log" May 28 19:02:34.912146 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:34.912119 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-9ggzc_e8524b7f-4d96-4630-a40b-05c29bec79e5/manager/0.log" May 28 19:02:35.006348 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:35.006324 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-554cn_c3240189-b454-439f-9e01-99101e4989bd/registry-server/0.log" May 28 19:02:36.833831 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:36.833761 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-jt84g_90f5d168-859e-4381-afd8-5705fef932e2/cluster-monitoring-operator/0.log" May 28 19:02:36.860619 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:36.860593 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wmll4_d688536b-0a33-4f5d-b794-949a52aba7dc/kube-state-metrics/0.log" May 28 19:02:36.900290 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:36.900265 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wmll4_d688536b-0a33-4f5d-b794-949a52aba7dc/kube-rbac-proxy-main/0.log" May 28 19:02:36.922346 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:36.922327 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wmll4_d688536b-0a33-4f5d-b794-949a52aba7dc/kube-rbac-proxy-self/0.log" May 28 19:02:36.950174 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:36.950144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77b499c556-qrvbb_97de5bd9-9b91-47a1-8455-1a3021da0645/metrics-server/0.log" May 28 19:02:37.010031 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.010005 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2fl4z_e6bab445-c28b-467c-942a-3403c456a507/node-exporter/0.log" May 28 19:02:37.033086 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.033052 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2fl4z_e6bab445-c28b-467c-942a-3403c456a507/kube-rbac-proxy/0.log" May 28 19:02:37.054128 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.054109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2fl4z_e6bab445-c28b-467c-942a-3403c456a507/init-textfile/0.log" May 28 19:02:37.259670 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.259644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-nk9t7_e9cb5e2f-aa64-442d-979d-8f150c02bb24/kube-rbac-proxy-main/0.log" May 28 19:02:37.281867 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.281842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-nk9t7_e9cb5e2f-aa64-442d-979d-8f150c02bb24/kube-rbac-proxy-self/0.log" May 28 19:02:37.306196 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.306176 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-nk9t7_e9cb5e2f-aa64-442d-979d-8f150c02bb24/openshift-state-metrics/0.log" May 28 19:02:37.566566 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:37.566470 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-phlm9_06fe9fea-e988-4c15-a208-8e0ea16c0678/prometheus-operator-admission-webhook/0.log" May 28 19:02:39.279896 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.279865 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/2.log" May 28 19:02:39.289806 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.284394 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6fzbj_31e687ed-4778-415d-a9b1-21ae28ebb824/console-operator/3.log" May 28 19:02:39.358221 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.358188 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4"] May 28 19:02:39.360773 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.360757 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.363013 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.362993 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fx658\"/\"default-dockercfg-dz7nn\"" May 28 19:02:39.363110 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.363095 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fx658\"/\"kube-root-ca.crt\"" May 28 19:02:39.364052 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.364037 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fx658\"/\"openshift-service-ca.crt\"" May 28 19:02:39.368761 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.368741 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4"] May 28 19:02:39.537021 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.536943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-proc\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.537021 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.536984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-podres\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.537183 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.537073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-sys\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.537183 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.537112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-lib-modules\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.537183 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.537141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqs6s\" (UniqueName: \"kubernetes.io/projected/76d3f54d-9932-4bd4-8995-edb7b920988a-kube-api-access-zqs6s\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.637730 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-sys\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.637897 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637758 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-lib-modules\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.637897 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637797 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqs6s\" (UniqueName: \"kubernetes.io/projected/76d3f54d-9932-4bd4-8995-edb7b920988a-kube-api-access-zqs6s\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.637897 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-sys\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.637897 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-proc\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.638105 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-podres\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.638105 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637970 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-lib-modules\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.638105 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.637996 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-proc\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.638105 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.638047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76d3f54d-9932-4bd4-8995-edb7b920988a-podres\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.645601 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.645577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqs6s\" (UniqueName: \"kubernetes.io/projected/76d3f54d-9932-4bd4-8995-edb7b920988a-kube-api-access-zqs6s\") pod \"perf-node-gather-daemonset-w94m4\" (UID: \"76d3f54d-9932-4bd4-8995-edb7b920988a\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.672350 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.672330 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:39.789691 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.789620 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85fb6c4846-94gjf_b9ab7465-4a1e-46bc-b4fd-b3a4e684e781/console/0.log" May 28 19:02:39.801307 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.801280 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4"] May 28 19:02:39.802956 ip-10-0-140-205 kubenswrapper[2559]: W0528 19:02:39.802924 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76d3f54d_9932_4bd4_8995_edb7b920988a.slice/crio-db384dc31e4538a29b9b6841caa2b28eb5f9e69ad0b4691366d9783ef09c2e2f WatchSource:0}: Error finding container db384dc31e4538a29b9b6841caa2b28eb5f9e69ad0b4691366d9783ef09c2e2f: Status 404 returned error can't find the container with id db384dc31e4538a29b9b6841caa2b28eb5f9e69ad0b4691366d9783ef09c2e2f May 28 19:02:39.804621 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.804604 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 19:02:39.827517 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.827494 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-tw2rn_b8714cbd-fca2-43e7-8dc0-58f92bdc16ba/download-server/0.log" May 28 19:02:39.956940 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:39.956914 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" event={"ID":"76d3f54d-9932-4bd4-8995-edb7b920988a","Type":"ContainerStarted","Data":"db384dc31e4538a29b9b6841caa2b28eb5f9e69ad0b4691366d9783ef09c2e2f"} May 28 19:02:40.317851 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:40.317823 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-stf2m_31ed9c7b-6d56-4a1b-a62a-38b6971fddb7/volume-data-source-validator/0.log" May 28 19:02:40.962688 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:40.962651 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" event={"ID":"76d3f54d-9932-4bd4-8995-edb7b920988a","Type":"ContainerStarted","Data":"90c54aba8a194356ff10fa0b37467ae6a8542f87a01d72fc3dce7a6b5cd50143"} May 28 19:02:40.962915 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:40.962777 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:40.979205 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:40.979161 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" podStartSLOduration=1.9791495860000001 podStartE2EDuration="1.979149586s" podCreationTimestamp="2026-05-28 19:02:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:02:40.976728673 +0000 UTC m=+2200.650864292" watchObservedRunningTime="2026-05-28 19:02:40.979149586 +0000 UTC m=+2200.653285201" May 28 19:02:41.197747 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:41.197717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqcr8_6f614b2f-6dea-4d48-849e-da6175b5cd2f/dns/0.log" May 28 19:02:41.221323 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:41.221263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqcr8_6f614b2f-6dea-4d48-849e-da6175b5cd2f/kube-rbac-proxy/0.log" May 28 19:02:41.245094 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:41.245071 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2ppnf_b41acff3-0ece-4328-843a-2bc8edcf41e7/dns-node-resolver/0.log" May 28 19:02:41.739604 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:41.739579 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d74d8d887-rhlk4_27e82561-e28d-4375-ad93-0fc77ae3b15d/registry/0.log" May 28 19:02:41.806723 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:41.806695 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w9kwh_75d1d08d-4455-4a3a-ab83-db075f4101eb/node-ca/0.log" May 28 19:02:42.567673 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:42.567644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bb222k_839b5acb-58f7-4d0a-be95-ee3031f72b5d/istio-proxy/0.log" May 28 19:02:42.827130 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:42.827050 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-7sk9r_e34f0aeb-93d8-4bfa-8f2a-d5b3c34be21b/istio-proxy/0.log" May 28 19:02:42.885551 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:42.885513 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-qzxl2_3b4d256c-9414-476c-a009-f8eaf6a7672b/payload-processing/0.log" May 28 19:02:42.906665 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:42.906641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-89bfcb4fb-nzlzm_2ceb4be7-01b2-4f34-babf-c42b2a24931a/router/0.log" May 28 19:02:43.405564 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:43.405521 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7w95w_41e0807d-ceb0-4eaa-a90d-5d302a2a5d9c/serve-healthcheck-canary/0.log" May 28 19:02:44.186458 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:44.186425 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wb6kn_f76d133b-aaac-4d0d-a2b1-d85584bb1d50/kube-rbac-proxy/0.log" May 28 19:02:44.206608 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:44.206582 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wb6kn_f76d133b-aaac-4d0d-a2b1-d85584bb1d50/exporter/0.log" May 28 19:02:44.227203 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:44.227181 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wb6kn_f76d133b-aaac-4d0d-a2b1-d85584bb1d50/extractor/0.log" May 28 19:02:46.425579 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:46.425555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67686c6958-nbcmk_2e98f487-70c5-45f4-9535-b123f8a0f505/manager/0.log" May 28 19:02:46.448272 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:46.448248 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-f9kzk_aae6219e-2389-4470-8d8f-35705cd5c008/postgres/0.log" May 28 19:02:46.976739 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:46.976708 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-w94m4" May 28 19:02:47.593581 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:47.593557 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77d4cfb68f-5wgln_a0454c11-71e6-4d64-b2d0-3005df3002c1/manager/0.log" May 28 19:02:47.641760 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:47.641734 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-chl75_400d1f21-a7cc-4827-8507-e3ecff934c17/openshift-lws-operator/0.log" May 28 19:02:53.638203 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.638174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/kube-multus-additional-cni-plugins/0.log" May 28 19:02:53.660203 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.660179 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/egress-router-binary-copy/0.log" May 28 19:02:53.683973 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.683938 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/cni-plugins/0.log" May 28 19:02:53.704317 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.704293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/bond-cni-plugin/0.log" May 28 19:02:53.724940 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.724914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/routeoverride-cni/0.log" May 28 19:02:53.745609 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.745588 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/whereabouts-cni-bincopy/0.log" May 28 19:02:53.766472 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.766446 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhwxh_48ac17ca-e9c6-47bc-badb-f8f1ace37c8e/whereabouts-cni/0.log" May 28 19:02:53.968098 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:53.968073 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n27xn_c561b3ab-660e-41dc-bc03-69103e70e7ae/kube-multus/0.log" May 28 19:02:54.091338 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:54.091313 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zqnxr_f00a9ddf-54b4-4627-9009-1cdd4e57125d/network-metrics-daemon/0.log" May 28 19:02:54.111502 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:54.111479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zqnxr_f00a9ddf-54b4-4627-9009-1cdd4e57125d/kube-rbac-proxy/0.log" May 28 19:02:55.503869 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.503841 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/ovn-controller/0.log" May 28 19:02:55.544562 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.544522 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/ovn-acl-logging/0.log" May 28 19:02:55.572153 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.572128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/kube-rbac-proxy-node/0.log" May 28 19:02:55.603149 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.603125 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/kube-rbac-proxy-ovn-metrics/0.log" May 28 19:02:55.648883 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.648862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/northd/0.log" May 28 19:02:55.684735 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.684714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/nbdb/0.log" May 28 19:02:55.719424 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.719403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/sbdb/0.log" May 28 19:02:55.819052 ip-10-0-140-205 kubenswrapper[2559]: I0528 19:02:55.818992 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrhm_ccb2702a-5877-47da-8034-dc390fc78f2a/ovnkube-controller/0.log"