Jul 02 19:03:26.298418 ip-10-0-137-48 systemd[1]: Starting Kubernetes Kubelet... Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.724628 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729969 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729980 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729983 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729986 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729989 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729993 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729996 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:03:26.731983 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.729998 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730001 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730004 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730007 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730009 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730012 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730014 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730017 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730019 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730022 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730024 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730027 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730037 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730040 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730042 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730045 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730048 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730050 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730054 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730056 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:03:26.735734 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730059 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730062 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730064 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730067 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730069 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730072 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730075 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730077 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730080 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730082 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730085 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730087 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730090 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730098 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730100 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730103 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730105 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730108 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730110 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730113 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:03:26.748146 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730126 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730128 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730131 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730134 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730137 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730139 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730142 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730153 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730158 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730161 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730164 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730167 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730170 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730173 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730176 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730179 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730182 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730185 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730187 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730190 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:03:26.750538 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730192 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730195 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730197 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730200 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730202 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730205 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730208 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730210 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730213 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730215 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730218 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730221 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730223 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730226 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730231 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730235 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730238 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730241 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730243 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:03:26.789695 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730246 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730249 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730252 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730255 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730257 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730260 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730263 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730266 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730270 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730273 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730276 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730279 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.730282 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733528 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733535 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733540 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733544 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733547 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733551 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733554 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:03:26.792473 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733556 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733559 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733562 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733565 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733568 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733571 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733574 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733577 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733579 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733582 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733584 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733604 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733609 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733612 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733615 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733619 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733622 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733625 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733628 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:03:26.861295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733631 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733633 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733636 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733639 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733642 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733644 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733647 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733649 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733652 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733655 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733658 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733660 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733663 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733665 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733667 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733670 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733672 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733675 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733678 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733680 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:03:26.864693 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733683 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:03:26.823096 ip-10-0-137-48 systemd[1]: Started Kubernetes Kubelet. Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733686 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733688 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733691 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733694 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733696 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733700 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733702 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733706 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733708 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733711 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733714 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733716 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733719 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733721 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733724 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733727 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733729 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733731 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:03:27.069134 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733735 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733738 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733741 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733744 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733746 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733749 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733751 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733754 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733756 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733759 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733761 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733764 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733767 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733769 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733771 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733774 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733777 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733779 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733782 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733784 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:03:27.086239 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733786 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733791 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733794 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733801 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733804 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733807 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733809 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733812 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733815 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733817 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733820 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733822 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733826 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.733829 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734247 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734259 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734263 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734266 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734269 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734271 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:03:27.087090 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734274 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734277 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734280 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734282 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734286 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734288 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734291 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734293 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734296 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734299 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734301 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734305 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734307 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734310 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734312 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734317 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734321 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734324 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734326 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734329 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:03:27.088798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734332 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734336 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734339 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734342 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734345 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734348 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734350 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734354 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734357 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734359 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734362 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734365 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734367 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734370 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734373 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734375 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734378 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734382 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734385 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734388 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:03:27.089606 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734390 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734393 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734396 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734398 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734401 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734404 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734406 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734409 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734411 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734413 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734416 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734418 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734421 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734426 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734429 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734431 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734434 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734437 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734439 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:03:27.090840 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734442 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734444 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734447 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734450 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734453 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734457 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734461 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734463 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734466 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734469 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734471 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734474 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734477 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734479 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734482 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734484 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734487 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734489 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734492 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:03:27.091678 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734494 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734497 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734499 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734502 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734504 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734507 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734509 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734514 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734516 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734520 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734524 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734527 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734529 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734533 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.734535 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734602 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734609 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734618 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734622 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734626 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734630 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 19:03:27.092899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734634 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734638 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734642 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734645 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734649 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734652 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734655 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734658 2582 flags.go:64] FLAG: --cgroup-root="" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734661 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734664 2582 flags.go:64] FLAG: --client-ca-file="" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734667 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734677 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734681 2582 flags.go:64] FLAG: --cluster-domain="" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734684 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734687 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734690 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734694 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734699 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734704 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734707 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734710 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734713 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734716 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734719 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 19:03:27.094971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734723 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734726 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734730 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734733 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734736 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734739 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734742 2582 flags.go:64] FLAG: --enable-server="true" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734745 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734749 2582 flags.go:64] FLAG: --event-burst="100" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734753 2582 flags.go:64] FLAG: --event-qps="50" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734755 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734758 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734761 2582 flags.go:64] FLAG: --eviction-hard="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734766 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734769 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734772 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734775 2582 flags.go:64] FLAG: --eviction-soft="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734778 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734781 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734784 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734786 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734789 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734792 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734795 2582 flags.go:64] FLAG: --feature-gates="" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734799 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 19:03:27.095690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734803 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734808 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734811 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734814 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734817 2582 flags.go:64] FLAG: --help="false" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734820 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734823 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734826 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734829 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734832 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734835 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734838 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734841 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734844 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734846 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734849 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734853 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734856 2582 flags.go:64] FLAG: --kube-reserved="" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734858 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734861 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734864 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734867 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734870 2582 flags.go:64] FLAG: --lock-file="" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734873 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 19:03:27.096425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734876 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734879 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734884 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734887 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734890 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734892 2582 flags.go:64] FLAG: --logging-format="text" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734895 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734899 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734903 2582 flags.go:64] FLAG: --manifest-url="" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734908 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734912 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734915 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734919 2582 flags.go:64] FLAG: --max-pods="110" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734922 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734925 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734928 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734931 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734934 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734938 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734941 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734948 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734951 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734954 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 19:03:27.097061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734957 2582 flags.go:64] FLAG: --pod-cidr="" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734960 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734966 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734969 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734972 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734975 2582 flags.go:64] FLAG: --port="10250" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734978 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734981 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06e92bf897d53e4c0" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734985 2582 flags.go:64] FLAG: --qos-reserved="" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734987 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734990 2582 flags.go:64] FLAG: --register-node="true" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734993 2582 flags.go:64] FLAG: --register-with-taints="" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734997 2582 flags.go:64] FLAG: --registry-burst="10" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.734999 2582 flags.go:64] FLAG: --registry-qps="5" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735002 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735005 2582 flags.go:64] FLAG: --reserved-memory="" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735009 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735013 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735016 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735020 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735023 2582 flags.go:64] FLAG: --runonce="false" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735026 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735029 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735032 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735035 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 19:03:27.097662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735038 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735041 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735044 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735047 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735050 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735052 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735055 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735058 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735061 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735063 2582 flags.go:64] FLAG: --system-cgroups="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735066 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735071 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735074 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735077 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735081 2582 flags.go:64] FLAG: --tls-min-version="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735084 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735087 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735090 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735092 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735095 2582 flags.go:64] FLAG: --v="2" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735099 2582 flags.go:64] FLAG: --version="false" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735103 2582 flags.go:64] FLAG: --vmodule="" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735106 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735109 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735271 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:03:27.098388 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735276 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735281 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735284 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735288 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735292 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735295 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735299 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735303 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735306 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735309 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735312 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735315 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735317 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735320 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735322 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735325 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735328 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735330 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735333 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:03:27.099014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735335 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735338 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735340 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735343 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735346 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735349 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735352 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735354 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735357 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735359 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735361 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735364 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735369 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735372 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735376 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735379 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735382 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735384 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735387 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735390 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:03:27.099494 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735393 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735395 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735398 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735401 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735403 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735406 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735408 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735411 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735413 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735416 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735418 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735421 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735423 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735426 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735428 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735431 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735434 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735437 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735439 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735442 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:03:27.100015 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735444 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735447 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735449 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735452 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735456 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735459 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735462 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735465 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735468 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735470 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735472 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735475 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735477 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735480 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735483 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735485 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735488 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735490 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735493 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735496 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:03:27.100512 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735498 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735500 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735503 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735505 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735508 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735510 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735513 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735515 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735518 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735521 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735523 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735526 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735528 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735531 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735533 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735536 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735539 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735542 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:03:27.101010 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.735546 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.735551 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.748401 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.748418 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.748437 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.748443 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748497 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748501 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748505 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748508 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748513 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748517 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748520 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748523 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:03:27.101476 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748526 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748529 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748531 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748534 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748537 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748540 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748542 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748545 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748548 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748550 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748553 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748556 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748561 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748564 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748567 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748569 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748572 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748575 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748577 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748580 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:03:27.101820 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748582 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748585 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748588 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748590 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748593 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748595 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748598 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748601 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748603 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748606 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748608 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748611 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748613 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748616 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748619 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748621 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748624 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748626 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748629 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748632 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:03:27.102330 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748634 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748637 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748640 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748642 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748647 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748649 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748652 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748655 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748657 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748660 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748662 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748666 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748670 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748673 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748676 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748679 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748682 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748685 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748688 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748692 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:03:27.102817 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748695 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748698 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748700 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748703 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748706 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748709 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748712 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748714 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748717 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748719 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748722 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748725 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748728 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748730 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748733 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748735 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748740 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748743 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748745 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748748 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:03:27.103313 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748750 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748753 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748755 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748759 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748762 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748764 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748767 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748770 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748772 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748775 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748777 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.748782 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748901 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748907 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748910 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:03:27.103798 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748913 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748916 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748919 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748922 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748925 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748927 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748930 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748933 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748936 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748940 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748942 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748945 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748947 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748952 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748954 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748957 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748960 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748962 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748965 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748967 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:03:27.104294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748970 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748974 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748976 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748979 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748981 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748984 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748987 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748990 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748992 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748995 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.748998 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749002 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749004 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749007 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749009 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749012 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749014 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749017 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749019 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749022 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:03:27.104808 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749024 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749026 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749029 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749032 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749035 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749038 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749041 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749043 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749046 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749048 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749052 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749055 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749058 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749063 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749065 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749068 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749071 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749073 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749076 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:03:27.105315 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749078 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749081 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749083 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749086 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749088 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749091 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749093 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749096 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749098 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749101 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749103 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749106 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749108 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749111 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749113 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749134 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749138 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749141 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749145 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749148 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:03:27.105780 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749150 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749153 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749156 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749158 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749161 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749163 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749167 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749169 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749172 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749174 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749177 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749180 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749182 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749185 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749187 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749191 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:03:27.106295 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:26.749194 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.749200 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.749304 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.751422 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.753057 2582 server.go:1019] "Starting client certificate rotation" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.753148 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.753189 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.756135 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.757256 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.769140 2582 log.go:25] "Validated CRI v1 runtime API" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.777749 2582 log.go:25] "Validated CRI v1 image API" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.779637 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:03:27.106706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.784332 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 19:03:27.107040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.786913 2582 fs.go:135] Filesystem UUIDs: map[1500aa26-5476-4c50-9895-715d0d8ebf64:/dev/nvme0n1p3 5601675c-2594-45b9-b48e-0ad5f2900a1c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 02 19:03:27.107040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.786926 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.794184 2582 manager.go:216] Machine: {Timestamp:2026-07-02 19:03:26.792542218 +0000 UTC m=+0.372962305 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096032 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b74e72b47d9e4413a51e4c64fc06c SystemUUID:ec2b74e7-2b47-d9e4-413a-51e4c64fc06c BootID:b4415664-711c-4a25-a21f-dbf1d9632a88 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:7f:f8:ba:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:7f:f8:ba:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:a4:6f:aa:fc:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.794351 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.794469 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.804033 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.804057 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.804969 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.804978 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.804986 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.805627 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.807156 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.808745 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9xhp" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810209 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810319 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810346 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810357 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810371 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 19:03:27.107103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810379 2582 kubelet.go:398] "Adding apiserver pod source" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810387 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810714 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.810731 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.812768 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.814937 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.814965 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816240 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816252 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816259 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816264 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816274 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816280 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816288 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816293 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816299 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816304 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816313 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816318 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.816502 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9xhp" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.817567 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.817584 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.820865 2582 server.go:1268] "Started kubelet" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.821204 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.821432 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.821493 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.822592 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.825012 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.827896 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.827913 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.828097 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-48.ec2.internal\" not found" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.828522 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.828532 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.828547 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.828649 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.828658 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.830821 2582 factory.go:153] Registering CRI-O factory Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.830835 2582 factory.go:223] Registration of the crio container factory successfully Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.832141 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.832151 2582 factory.go:55] Registering systemd factory Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.832159 2582 factory.go:223] Registration of the systemd container factory successfully Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.832181 2582 factory.go:103] Registering Raw factory Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.832195 2582 manager.go:1196] Started watching for new ooms in manager Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.853537 2582 manager.go:349] Starting recovery of all containers Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.861371 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.863497 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.865227 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.865260 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-48.ec2.internal\" not found" node="ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.890418 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.892598 2582 manager.go:354] Recovery completed Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.892922 2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-48.ec2.internal" not found Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.897881 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:03:27.107572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.899849 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.899876 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.899891 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.900444 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.900456 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.900465 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.900474 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.901142 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.901163 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.901173 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.901803 2582 policy_none.go:49] "None policy: Start" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.901815 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.901826 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.902802 2582 policy_none.go:47] "Start" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.908513 2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-48.ec2.internal" not found Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.928149 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-48.ec2.internal\" not found" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.945651 2582 manager.go:337] "Starting Device Plugin manager" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.945682 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.945693 2582 server.go:87] "Starting device plugin registration server" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.945900 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.945911 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.946244 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.946296 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.946301 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.946758 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:26.946803 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-48.ec2.internal\" not found" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:26.964261 2582 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-48.ec2.internal" not found Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.019417 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.020529 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.020585 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.020608 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:27.020644 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.022974 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.046278 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.052494 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.052517 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.052530 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.052552 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.063062 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.108883 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:27.063085 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-48.ec2.internal\": node \"ip-10-0-137-48.ec2.internal\" not found" Jul 02 19:03:27.121189 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.121037 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal"] Jul 02 19:03:27.123593 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.123578 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.124423 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.124406 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.128584 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.128566 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.130350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.130329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49289221ee726540fe6b771ca05823b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" (UID: \"49289221ee726540fe6b771ca05823b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.130436 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.130366 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49289221ee726540fe6b771ca05823b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" (UID: \"49289221ee726540fe6b771ca05823b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.130436 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.130395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44ccf5d2bec11f5aed6f9eee7ef6e2b0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-48.ec2.internal\" (UID: \"44ccf5d2bec11f5aed6f9eee7ef6e2b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.139625 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.139608 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.143476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.143462 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.144805 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.144792 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:03:27.144885 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.144876 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.162340 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.162323 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:03:27.162413 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:27.162357 2582 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-48.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.162810 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.162800 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:03:27.162935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.162921 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:03:27.162986 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:27.162959 2582 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.231418 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.231397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49289221ee726540fe6b771ca05823b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" (UID: \"49289221ee726540fe6b771ca05823b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.231486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.231422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49289221ee726540fe6b771ca05823b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" (UID: \"49289221ee726540fe6b771ca05823b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.231486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.231440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44ccf5d2bec11f5aed6f9eee7ef6e2b0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-48.ec2.internal\" (UID: \"44ccf5d2bec11f5aed6f9eee7ef6e2b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.231486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.231465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44ccf5d2bec11f5aed6f9eee7ef6e2b0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-48.ec2.internal\" (UID: \"44ccf5d2bec11f5aed6f9eee7ef6e2b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.231598 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.231487 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49289221ee726540fe6b771ca05823b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" (UID: \"49289221ee726540fe6b771ca05823b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.231598 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.231513 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49289221ee726540fe6b771ca05823b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal\" (UID: \"49289221ee726540fe6b771ca05823b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.466734 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.466636 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" Jul 02 19:03:27.469232 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:27.469210 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" Jul 02 19:03:28.797236 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.797177 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 19:03:28.797639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.797329 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:03:28.797639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.797341 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:03:28.797639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.797362 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:03:28.855662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.855635 2582 apiserver.go:52] "Watching apiserver" Jul 02 19:03:28.865574 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.864491 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 19:03:28.865574 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.865162 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5qchw","openshift-image-registry/node-ca-vvw5b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal","openshift-multus/multus-4mn26","kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal","openshift-multus/multus-additional-cni-plugins-k8k6v","openshift-multus/network-metrics-daemon-jnvdh","openshift-network-diagnostics/network-check-target-l552f","openshift-network-operator/iptables-alerter-nm6hr","openshift-ovn-kubernetes/ovnkube-node-8b44h","kube-system/global-pull-secret-syncer-zdbp6","kube-system/konnectivity-agent-2dmtd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4","openshift-cluster-node-tuning-operator/tuned-tkwg8"] Jul 02 19:03:28.866042 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.865968 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:58:27 +0000 UTC" deadline="2028-04-06 13:53:22.67019037 +0000 UTC" Jul 02 19:03:28.866279 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.866263 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15450h49m53.803935672s" Jul 02 19:03:28.867578 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.867550 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.869332 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.869315 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.869921 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.869902 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.869965 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.869922 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.869965 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.869903 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hzbsj\"" Jul 02 19:03:28.871033 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.871005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.871135 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.871122 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tg52x\"" Jul 02 19:03:28.871477 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.871462 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.871561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.871513 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.871561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.871559 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 19:03:28.872360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.872346 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.872683 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.872669 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 19:03:28.873043 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.873028 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 19:03:28.873301 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.873285 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7szr2\"" Jul 02 19:03:28.873426 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.873407 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.873538 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.873516 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 19:03:28.873607 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.873547 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.874053 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.874035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:28.874135 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:28.874114 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:28.874382 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.874370 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 19:03:28.874432 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.874416 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sj9gc\"" Jul 02 19:03:28.874575 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.874564 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 19:03:28.875422 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.875407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:28.875500 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:28.875452 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:28.876691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.876677 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:28.878142 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878126 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.878220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vlr\" (UniqueName: \"kubernetes.io/projected/3245b487-a7c6-450b-9c8a-0f77f928e6ab-kube-api-access-h4vlr\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:28.878220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-hosts-file\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.878220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-tmp-dir\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.878220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-netns\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-kubelet\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878226 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66cpf\" (UniqueName: \"kubernetes.io/projected/35d99939-d2f7-45f7-98b0-bfbacb4e7554-kube-api-access-66cpf\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4mtj\" (UniqueName: \"kubernetes.io/projected/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-kube-api-access-k4mtj\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-host\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-os-release\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-daemon-config\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878332 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-hostroot\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878399 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-k8s-cni-cncf-io\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878440 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-os-release\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-cni-multus\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-multus-certs\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878529 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-etc-kubernetes\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc9k4\" (UniqueName: \"kubernetes.io/projected/26cd1bbc-6409-4610-81a2-d0451f36dcad-kube-api-access-mc9k4\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35d99939-d2f7-45f7-98b0-bfbacb4e7554-cni-binary-copy\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-serviceca\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-system-cni-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-cnibin\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878718 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-cni-bin\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878732 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-conf-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.878742 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878746 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-system-cni-dir\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878750 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-cnibin\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlc4f\" (UniqueName: \"kubernetes.io/projected/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-kube-api-access-dlc4f\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-cni-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.878861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-socket-dir-parent\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.879050 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.879066 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.879296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.879154 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bxdk7\"" Jul 02 19:03:28.880039 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.880022 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:28.880103 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:28.880069 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:28.880524 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.880510 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 19:03:28.880770 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.880754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 19:03:28.880861 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.880802 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.880861 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.880822 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 19:03:28.880861 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.880841 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.881356 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.881344 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:28.881903 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.881889 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 19:03:28.881991 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.881978 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jfmgw\"" Jul 02 19:03:28.882687 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.882673 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.884046 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.884030 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.884267 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.884145 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-slcjc\"" Jul 02 19:03:28.884267 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.884164 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 19:03:28.884714 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.884645 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 19:03:28.885498 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.885139 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cj2xk\"" Jul 02 19:03:28.885498 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.885180 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.885498 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.885390 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.885498 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.885392 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:03:28.885710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.885618 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 19:03:28.886428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.886409 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f4vbc\"" Jul 02 19:03:28.886959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.886919 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:03:28.887731 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.887711 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 19:03:28.907014 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.906992 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hx9z7" Jul 02 19:03:28.914829 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.914805 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hx9z7" Jul 02 19:03:28.974197 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.974182 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 19:03:28.979671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-socket-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.979796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:28.979796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979720 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-serviceca\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.979796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-cni-bin\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.979959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-env-overrides\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.979959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-kubernetes\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.979959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-cni-bin\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.979959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979851 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-var-lib-kubelet\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.979959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979893 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlc4f\" (UniqueName: \"kubernetes.io/projected/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-kube-api-access-dlc4f\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.979959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92e3a56c-727f-4d88-85ec-a6a9a811689d-tmp\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-systemd\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.979987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-log-socket\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3fa5d04-148a-432e-b453-96e3fe5802b5-host-slash\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-slash\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-run-ovn-kubernetes\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-cni-bin\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980136 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-registration-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px7th\" (UniqueName: \"kubernetes.io/projected/8cc11cea-4f03-46c2-8e07-cc94593acafa-kube-api-access-px7th\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysctl-d\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980200 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-lib-modules\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-etc-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980234 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-serviceca\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-k8s-cni-cncf-io\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-k8s-cni-cncf-io\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-kubelet\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980393 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee-konnectivity-ca\") pod \"konnectivity-agent-2dmtd\" (UID: \"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee\") " pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-systemd\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:28.980431 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc9k4\" (UniqueName: \"kubernetes.io/projected/26cd1bbc-6409-4610-81a2-d0451f36dcad-kube-api-access-mc9k4\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:28.980504 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:03:29.480485153 +0000 UTC m=+2.016242649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-host\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whph\" (UniqueName: \"kubernetes.io/projected/92e3a56c-727f-4d88-85ec-a6a9a811689d-kube-api-access-5whph\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.980671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35d99939-d2f7-45f7-98b0-bfbacb4e7554-cni-binary-copy\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-device-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-system-cni-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-cnibin\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-conf-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-system-cni-dir\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980831 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-system-cni-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-cnibin\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-conf-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-modprobe-d\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980891 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-system-cni-dir\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysconfig\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-cnibin\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980909 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-cnibin\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980941 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-cni-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-socket-dir-parent\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.980980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vlr\" (UniqueName: \"kubernetes.io/projected/3245b487-a7c6-450b-9c8a-0f77f928e6ab-kube-api-access-h4vlr\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:28.981276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-run-netns\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-ovn\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-ovnkube-config\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-ovnkube-script-lib\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-hosts-file\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981137 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-cni-dir\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-tmp-dir\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981120 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-socket-dir-parent\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-netns\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981197 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35d99939-d2f7-45f7-98b0-bfbacb4e7554-cni-binary-copy\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-kubelet\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-hosts-file\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981267 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-netns\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66cpf\" (UniqueName: \"kubernetes.io/projected/35d99939-d2f7-45f7-98b0-bfbacb4e7554-kube-api-access-66cpf\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981301 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-kubelet\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx67h\" (UniqueName: \"kubernetes.io/projected/500c3995-f510-4cc7-a9b0-ab7abf494118-kube-api-access-tx67h\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-tuned\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981381 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3fa5d04-148a-432e-b453-96e3fe5802b5-iptables-alerter-script\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981427 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4mtj\" (UniqueName: \"kubernetes.io/projected/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-kube-api-access-k4mtj\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-host\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-os-release\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981483 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-tmp-dir\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-daemon-config\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-var-lib-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981537 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-host\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981580 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-os-release\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/500c3995-f510-4cc7-a9b0-ab7abf494118-ovn-node-metrics-cert\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-run\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-sys\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-hostroot\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981697 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-hostroot\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981774 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee-agent-certs\") pod \"konnectivity-agent-2dmtd\" (UID: \"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee\") " pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:28.982703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ed2587e-2a26-430f-9c12-42656f301bde-dbus\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-os-release\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-node-log\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981894 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-cni-netd\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-sys-fs\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35d99939-d2f7-45f7-98b0-bfbacb4e7554-multus-daemon-config\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.981933 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26cd1bbc-6409-4610-81a2-d0451f36dcad-os-release\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysctl-conf\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmw8x\" (UniqueName: \"kubernetes.io/projected/f3fa5d04-148a-432e-b453-96e3fe5802b5-kube-api-access-mmw8x\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ed2587e-2a26-430f-9c12-42656f301bde-kubelet-config\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-cni-multus\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-multus-certs\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-etc-kubernetes\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982236 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982246 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-var-lib-cni-multus\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982278 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-host-run-multus-certs\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982286 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d99939-d2f7-45f7-98b0-bfbacb4e7554-etc-kubernetes\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982283 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-systemd-units\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982297 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982702 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.983754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.982702 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26cd1bbc-6409-4610-81a2-d0451f36dcad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.986669 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.986643 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 19:03:28.989975 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.989953 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlc4f\" (UniqueName: \"kubernetes.io/projected/19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24-kube-api-access-dlc4f\") pod \"node-ca-vvw5b\" (UID: \"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24\") " pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:28.991899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.991871 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc9k4\" (UniqueName: \"kubernetes.io/projected/26cd1bbc-6409-4610-81a2-d0451f36dcad-kube-api-access-mc9k4\") pod \"multus-additional-cni-plugins-k8k6v\" (UID: \"26cd1bbc-6409-4610-81a2-d0451f36dcad\") " pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:28.993058 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.993031 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4mtj\" (UniqueName: \"kubernetes.io/projected/4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5-kube-api-access-k4mtj\") pod \"node-resolver-5qchw\" (UID: \"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5\") " pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:28.993282 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.993260 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vlr\" (UniqueName: \"kubernetes.io/projected/3245b487-a7c6-450b-9c8a-0f77f928e6ab-kube-api-access-h4vlr\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:28.993482 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:28.993464 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66cpf\" (UniqueName: \"kubernetes.io/projected/35d99939-d2f7-45f7-98b0-bfbacb4e7554-kube-api-access-66cpf\") pod \"multus-4mn26\" (UID: \"35d99939-d2f7-45f7-98b0-bfbacb4e7554\") " pod="openshift-multus/multus-4mn26" Jul 02 19:03:29.083359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-host\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whph\" (UniqueName: \"kubernetes.io/projected/92e3a56c-727f-4d88-85ec-a6a9a811689d-kube-api-access-5whph\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-device-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083366 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-modprobe-d\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysconfig\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-run-netns\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083418 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-host\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-ovn\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083447 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-device-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083453 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysconfig\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083477 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-run-netns\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083481 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-ovn\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083490 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-modprobe-d\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083500 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-ovnkube-config\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-ovnkube-script-lib\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.083581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx67h\" (UniqueName: \"kubernetes.io/projected/500c3995-f510-4cc7-a9b0-ab7abf494118-kube-api-access-tx67h\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-tuned\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3fa5d04-148a-432e-b453-96e3fe5802b5-iptables-alerter-script\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-var-lib-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/500c3995-f510-4cc7-a9b0-ab7abf494118-ovn-node-metrics-cert\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083674 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-run\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083683 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-sys\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083738 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-sys\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083752 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee-agent-certs\") pod \"konnectivity-agent-2dmtd\" (UID: \"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee\") " pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083774 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ed2587e-2a26-430f-9c12-42656f301bde-dbus\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-node-log\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-cni-netd\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083861 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-sys-fs\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysctl-conf\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083886 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-var-lib-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.084297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083921 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmw8x\" (UniqueName: \"kubernetes.io/projected/f3fa5d04-148a-432e-b453-96e3fe5802b5-kube-api-access-mmw8x\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083933 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083949 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ed2587e-2a26-430f-9c12-42656f301bde-kubelet-config\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.083978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-systemd-units\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-socket-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-env-overrides\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084137 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-ovnkube-config\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-kubernetes\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084171 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-ovnkube-script-lib\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084197 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-node-log\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084220 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-var-lib-kubelet\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084249 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-cni-netd\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-var-lib-kubelet\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084281 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-run\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92e3a56c-727f-4d88-85ec-a6a9a811689d-tmp\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084315 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ed2587e-2a26-430f-9c12-42656f301bde-dbus\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084323 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysctl-conf\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-systemd\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-log-socket\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084391 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3fa5d04-148a-432e-b453-96e3fe5802b5-host-slash\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-slash\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084419 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-socket-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-run-ovn-kubernetes\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-cni-bin\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-registration-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ed2587e-2a26-430f-9c12-42656f301bde-kubelet-config\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084514 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px7th\" (UniqueName: \"kubernetes.io/projected/8cc11cea-4f03-46c2-8e07-cc94593acafa-kube-api-access-px7th\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysctl-d\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-lib-modules\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-etc-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.085935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-kubelet\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee-konnectivity-ca\") pod \"konnectivity-agent-2dmtd\" (UID: \"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee\") " pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-systemd\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-run-systemd\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084812 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3fa5d04-148a-432e-b453-96e3fe5802b5-iptables-alerter-script\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084835 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-cni-bin\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.084880 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084885 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-registration-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084893 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-kubernetes\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084717 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.084950 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:03:29.584913669 +0000 UTC m=+2.120671152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.084980 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-kubelet\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085005 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/500c3995-f510-4cc7-a9b0-ab7abf494118-env-overrides\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085019 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-systemd-units\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085032 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-lib-modules\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085053 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-log-socket\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085055 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-slash\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.086697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085067 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-etc-openvswitch\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085091 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8cc11cea-4f03-46c2-8e07-cc94593acafa-sys-fs\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085135 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500c3995-f510-4cc7-a9b0-ab7abf494118-host-run-ovn-kubernetes\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085150 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-sysctl-d\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085135 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-systemd\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085134 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3fa5d04-148a-432e-b453-96e3fe5802b5-host-slash\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.085614 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee-konnectivity-ca\") pod \"konnectivity-agent-2dmtd\" (UID: \"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee\") " pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.086771 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/500c3995-f510-4cc7-a9b0-ab7abf494118-ovn-node-metrics-cert\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.086824 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92e3a56c-727f-4d88-85ec-a6a9a811689d-tmp\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.086973 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92e3a56c-727f-4d88-85ec-a6a9a811689d-etc-tuned\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.087358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.087143 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee-agent-certs\") pod \"konnectivity-agent-2dmtd\" (UID: \"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee\") " pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:29.090332 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.090309 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:03:29.090427 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.090336 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:03:29.090427 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.090349 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:29.090427 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.090424 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:03:29.590405015 +0000 UTC m=+2.126162515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:29.091454 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.091436 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whph\" (UniqueName: \"kubernetes.io/projected/92e3a56c-727f-4d88-85ec-a6a9a811689d-kube-api-access-5whph\") pod \"tuned-tkwg8\" (UID: \"92e3a56c-727f-4d88-85ec-a6a9a811689d\") " pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.091757 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.091735 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx67h\" (UniqueName: \"kubernetes.io/projected/500c3995-f510-4cc7-a9b0-ab7abf494118-kube-api-access-tx67h\") pod \"ovnkube-node-8b44h\" (UID: \"500c3995-f510-4cc7-a9b0-ab7abf494118\") " pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.091846 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.091774 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmw8x\" (UniqueName: \"kubernetes.io/projected/f3fa5d04-148a-432e-b453-96e3fe5802b5-kube-api-access-mmw8x\") pod \"iptables-alerter-nm6hr\" (UID: \"f3fa5d04-148a-432e-b453-96e3fe5802b5\") " pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.092924 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.092908 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px7th\" (UniqueName: \"kubernetes.io/projected/8cc11cea-4f03-46c2-8e07-cc94593acafa-kube-api-access-px7th\") pod \"aws-ebs-csi-driver-node-m7gr4\" (UID: \"8cc11cea-4f03-46c2-8e07-cc94593acafa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.096547 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.096521 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49289221ee726540fe6b771ca05823b8.slice/crio-56b8a2d833803d37cce7a4d7397bd9bc58fefd5ac4088c7a522df60f7164401c WatchSource:0}: Error finding container 56b8a2d833803d37cce7a4d7397bd9bc58fefd5ac4088c7a522df60f7164401c: Status 404 returned error can't find the container with id 56b8a2d833803d37cce7a4d7397bd9bc58fefd5ac4088c7a522df60f7164401c Jul 02 19:03:29.096761 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.096744 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ccf5d2bec11f5aed6f9eee7ef6e2b0.slice/crio-89f4f58c0f6fb15a162f9f0ac79e8eedd5064e58dbfed8f1926e1e30867201fa WatchSource:0}: Error finding container 89f4f58c0f6fb15a162f9f0ac79e8eedd5064e58dbfed8f1926e1e30867201fa: Status 404 returned error can't find the container with id 89f4f58c0f6fb15a162f9f0ac79e8eedd5064e58dbfed8f1926e1e30867201fa Jul 02 19:03:29.100301 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.100287 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:03:29.214403 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.214380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qchw" Jul 02 19:03:29.223503 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.223480 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4c25bb_c741_4b4a_a5a9_202fa9a43bf5.slice/crio-870c9766d3da980219779319efa190639a06ad92ef6c12d44318aaae10d8e100 WatchSource:0}: Error finding container 870c9766d3da980219779319efa190639a06ad92ef6c12d44318aaae10d8e100: Status 404 returned error can't find the container with id 870c9766d3da980219779319efa190639a06ad92ef6c12d44318aaae10d8e100 Jul 02 19:03:29.234135 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.234113 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvw5b" Jul 02 19:03:29.241802 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.241767 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b9b2c4_b420_4ea8_86e9_bdaa3dc5bf24.slice/crio-e5a64c553076bfeb1da169592d1d0b3ac3a59f0e7656052cfa5da7819c634d51 WatchSource:0}: Error finding container e5a64c553076bfeb1da169592d1d0b3ac3a59f0e7656052cfa5da7819c634d51: Status 404 returned error can't find the container with id e5a64c553076bfeb1da169592d1d0b3ac3a59f0e7656052cfa5da7819c634d51 Jul 02 19:03:29.251936 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.251920 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4mn26" Jul 02 19:03:29.259376 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.259358 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d99939_d2f7_45f7_98b0_bfbacb4e7554.slice/crio-1655fe0ba9be08d9dd5e2f57d200f6691c681a76ca94a24863c97971ca951e99 WatchSource:0}: Error finding container 1655fe0ba9be08d9dd5e2f57d200f6691c681a76ca94a24863c97971ca951e99: Status 404 returned error can't find the container with id 1655fe0ba9be08d9dd5e2f57d200f6691c681a76ca94a24863c97971ca951e99 Jul 02 19:03:29.272189 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.272171 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" Jul 02 19:03:29.282530 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.282510 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cd1bbc_6409_4610_81a2_d0451f36dcad.slice/crio-6e7670ed03eb6d12d20227218d36660555559f82ea30720a223aeb085a59b36d WatchSource:0}: Error finding container 6e7670ed03eb6d12d20227218d36660555559f82ea30720a223aeb085a59b36d: Status 404 returned error can't find the container with id 6e7670ed03eb6d12d20227218d36660555559f82ea30720a223aeb085a59b36d Jul 02 19:03:29.288954 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.288933 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nm6hr" Jul 02 19:03:29.296117 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.296098 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fa5d04_148a_432e_b453_96e3fe5802b5.slice/crio-8040c927da43a761a0e4069cce0caab3bbaaeaa0a65d9b9a8a91daa0ef4bdae5 WatchSource:0}: Error finding container 8040c927da43a761a0e4069cce0caab3bbaaeaa0a65d9b9a8a91daa0ef4bdae5: Status 404 returned error can't find the container with id 8040c927da43a761a0e4069cce0caab3bbaaeaa0a65d9b9a8a91daa0ef4bdae5 Jul 02 19:03:29.312429 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.312408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:29.319858 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.319840 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500c3995_f510_4cc7_a9b0_ab7abf494118.slice/crio-e8f1bf21ddd6f4918223aa595c4ea9700ae314229c458678be569cfda8f981c4 WatchSource:0}: Error finding container e8f1bf21ddd6f4918223aa595c4ea9700ae314229c458678be569cfda8f981c4: Status 404 returned error can't find the container with id e8f1bf21ddd6f4918223aa595c4ea9700ae314229c458678be569cfda8f981c4 Jul 02 19:03:29.325688 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.325671 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:29.331397 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.331380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" Jul 02 19:03:29.332968 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.332950 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1a1fca_fb70_4fb3_9be7_8d84fe2f06ee.slice/crio-166f1642aa83bdd471188b8c91386f061f0a046f29db4d25308c7becbf7a3b1c WatchSource:0}: Error finding container 166f1642aa83bdd471188b8c91386f061f0a046f29db4d25308c7becbf7a3b1c: Status 404 returned error can't find the container with id 166f1642aa83bdd471188b8c91386f061f0a046f29db4d25308c7becbf7a3b1c Jul 02 19:03:29.334830 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.334737 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" Jul 02 19:03:29.341446 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.341429 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc11cea_4f03_46c2_8e07_cc94593acafa.slice/crio-b17b2e1062cb4a9b9bbce35d0a00f38d5c7325407742a3f3043fd14200fff1fe WatchSource:0}: Error finding container b17b2e1062cb4a9b9bbce35d0a00f38d5c7325407742a3f3043fd14200fff1fe: Status 404 returned error can't find the container with id b17b2e1062cb4a9b9bbce35d0a00f38d5c7325407742a3f3043fd14200fff1fe Jul 02 19:03:29.345914 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:03:29.345897 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e3a56c_727f_4d88_85ec_a6a9a811689d.slice/crio-8e492612ad7ff9566fee7a5de68a4f24d2c3dd5d5c0018f4c2be766888ac8051 WatchSource:0}: Error finding container 8e492612ad7ff9566fee7a5de68a4f24d2c3dd5d5c0018f4c2be766888ac8051: Status 404 returned error can't find the container with id 8e492612ad7ff9566fee7a5de68a4f24d2c3dd5d5c0018f4c2be766888ac8051 Jul 02 19:03:29.488208 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.488180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:29.488345 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.488317 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:29.488391 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.488372 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:03:30.488357958 +0000 UTC m=+3.024115440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:29.589361 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.589291 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:29.589469 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.589413 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:29.589510 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.589470 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:03:30.589454136 +0000 UTC m=+3.125211614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:29.690188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.690157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:29.690348 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.690294 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:03:29.690348 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.690315 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:03:29.690348 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.690327 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:29.690507 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:29.690389 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:03:30.690370623 +0000 UTC m=+3.226128104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:29.694308 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.694287 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:29.917324 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.917176 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:58:28 +0000 UTC" deadline="2028-01-15 20:33:44.947338715 +0000 UTC" Jul 02 19:03:29.917324 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.917244 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13489h30m15.030098618s" Jul 02 19:03:29.987287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:29.987257 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:30.072748 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.072719 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:30.072926 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.072719 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:30.072926 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.072880 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:30.073034 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.072946 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:30.082126 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.082081 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerStarted","Data":"6e7670ed03eb6d12d20227218d36660555559f82ea30720a223aeb085a59b36d"} Jul 02 19:03:30.090437 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.090407 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" event={"ID":"49289221ee726540fe6b771ca05823b8","Type":"ContainerStarted","Data":"56b8a2d833803d37cce7a4d7397bd9bc58fefd5ac4088c7a522df60f7164401c"} Jul 02 19:03:30.094418 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.094393 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nm6hr" event={"ID":"f3fa5d04-148a-432e-b453-96e3fe5802b5","Type":"ContainerStarted","Data":"8040c927da43a761a0e4069cce0caab3bbaaeaa0a65d9b9a8a91daa0ef4bdae5"} Jul 02 19:03:30.098518 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.098492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4mn26" event={"ID":"35d99939-d2f7-45f7-98b0-bfbacb4e7554","Type":"ContainerStarted","Data":"1655fe0ba9be08d9dd5e2f57d200f6691c681a76ca94a24863c97971ca951e99"} Jul 02 19:03:30.108864 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.108839 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvw5b" event={"ID":"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24","Type":"ContainerStarted","Data":"e5a64c553076bfeb1da169592d1d0b3ac3a59f0e7656052cfa5da7819c634d51"} Jul 02 19:03:30.113688 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.113663 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qchw" event={"ID":"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5","Type":"ContainerStarted","Data":"870c9766d3da980219779319efa190639a06ad92ef6c12d44318aaae10d8e100"} Jul 02 19:03:30.116318 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.116293 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" event={"ID":"44ccf5d2bec11f5aed6f9eee7ef6e2b0","Type":"ContainerStarted","Data":"89f4f58c0f6fb15a162f9f0ac79e8eedd5064e58dbfed8f1926e1e30867201fa"} Jul 02 19:03:30.127607 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.127553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" event={"ID":"92e3a56c-727f-4d88-85ec-a6a9a811689d","Type":"ContainerStarted","Data":"8e492612ad7ff9566fee7a5de68a4f24d2c3dd5d5c0018f4c2be766888ac8051"} Jul 02 19:03:30.135044 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.135006 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" event={"ID":"8cc11cea-4f03-46c2-8e07-cc94593acafa","Type":"ContainerStarted","Data":"b17b2e1062cb4a9b9bbce35d0a00f38d5c7325407742a3f3043fd14200fff1fe"} Jul 02 19:03:30.143605 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.143446 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2dmtd" event={"ID":"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee","Type":"ContainerStarted","Data":"166f1642aa83bdd471188b8c91386f061f0a046f29db4d25308c7becbf7a3b1c"} Jul 02 19:03:30.165403 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.165379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"e8f1bf21ddd6f4918223aa595c4ea9700ae314229c458678be569cfda8f981c4"} Jul 02 19:03:30.232689 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.232605 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:03:30.497977 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.497336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:30.497977 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.497497 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:30.497977 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.497552 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:03:32.497534222 +0000 UTC m=+5.033291706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:30.598414 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.598357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:30.598596 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.598507 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:30.598596 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.598571 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:03:32.598553258 +0000 UTC m=+5.134310743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:30.698967 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.698927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:30.699132 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.699118 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:03:30.699203 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.699137 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:03:30.699203 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.699150 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:30.699353 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:30.699210 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:03:32.699191103 +0000 UTC m=+5.234948603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:30.918466 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.918377 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:58:28 +0000 UTC" deadline="2028-03-29 12:41:08.200851424 +0000 UTC" Jul 02 19:03:30.918466 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:30.918425 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15257h37m37.282437819s" Jul 02 19:03:31.066329 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:31.066297 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:31.066497 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:31.066431 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:32.066053 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:32.066023 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:32.066492 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.066195 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:32.066697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:32.066591 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:32.066755 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.066694 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:32.514836 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:32.514223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:32.514836 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.514377 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:32.514836 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.514441 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:03:36.514421676 +0000 UTC m=+9.050179169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:32.616087 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:32.615279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:32.616087 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.615459 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:32.616087 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.615605 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:03:36.615583977 +0000 UTC m=+9.151341471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:32.716027 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:32.715992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:32.716199 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.716143 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:03:32.716199 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.716162 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:03:32.716199 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.716173 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:32.716388 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:32.716229 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:03:36.716212048 +0000 UTC m=+9.251969541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:33.066415 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:33.066384 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:33.067001 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:33.066512 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:34.065952 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:34.065775 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:34.065952 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:34.065937 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:34.066246 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:34.066191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:34.066342 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:34.066314 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:35.066131 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:35.066096 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:35.066585 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:35.066234 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:36.065956 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:36.065925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:36.066133 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:36.065926 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:36.066133 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.066061 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:36.066133 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.066110 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:36.544310 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:36.543909 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:36.544310 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.544056 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:36.544310 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.544125 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:03:44.544105939 +0000 UTC m=+17.079863421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:36.644937 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:36.644899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:36.645105 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.645069 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:36.645188 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.645153 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:03:44.645132765 +0000 UTC m=+17.180890249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:36.746057 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:36.745961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:36.746213 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.746139 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:03:36.746213 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.746157 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:03:36.746213 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.746169 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:36.746365 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:36.746279 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:03:44.746240655 +0000 UTC m=+17.281998135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:37.066260 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:37.066175 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:37.066684 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:37.066302 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:38.066646 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:38.066599 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:38.067161 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:38.066717 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:38.067161 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:38.066770 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:38.067161 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:38.066858 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:39.066344 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:39.066257 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:39.066536 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:39.066458 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:40.066590 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:40.066086 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:40.066590 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:40.066247 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:40.066590 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:40.066324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:40.066590 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:40.066433 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:41.065837 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:41.065800 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:41.065977 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:41.065910 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:42.065569 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:42.065491 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:42.066022 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:42.065652 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:42.066022 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:42.065658 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:42.066022 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:42.065749 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:43.066448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:43.066415 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:43.066876 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:43.066543 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:44.065988 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:44.065954 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:44.066181 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:44.065957 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:44.066181 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.066101 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:44.066181 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.066171 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:44.605338 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:44.605288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:44.605911 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.605440 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:44.605911 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.605514 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:04:00.605494983 +0000 UTC m=+33.141252467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:03:44.706017 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:44.705979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:44.706176 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.706144 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:44.706249 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.706222 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:04:00.706200722 +0000 UTC m=+33.241958203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:03:44.806618 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:44.806582 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:44.806800 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.806707 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:03:44.806800 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.806726 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:03:44.806800 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.806741 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:44.806982 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:44.806833 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:04:00.806808181 +0000 UTC m=+33.342565662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:03:45.066381 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:45.066348 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:45.066553 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:45.066460 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:46.065794 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:46.065745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:46.066248 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:46.065907 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:46.066248 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:46.065960 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:46.066248 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:46.066081 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:47.066075 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:47.066026 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:47.066510 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:47.066154 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:48.067356 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:48.067119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:48.067855 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:48.067196 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:48.067855 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:48.067462 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:48.067855 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:48.067536 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:49.066392 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:49.066304 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:49.066554 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:49.066432 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:50.066466 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.066248 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:50.067366 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.066298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:50.067366 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:50.066519 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:50.067366 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:50.066555 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:50.217428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.217399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nm6hr" event={"ID":"f3fa5d04-148a-432e-b453-96e3fe5802b5","Type":"ContainerStarted","Data":"add6ef6da7407637c9c3472f2f035b40b61b001b14c916ae0d98b98bb29fcd54"} Jul 02 19:03:50.219165 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.219144 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4mn26" event={"ID":"35d99939-d2f7-45f7-98b0-bfbacb4e7554","Type":"ContainerStarted","Data":"b3720d230382d3696e69e6ab68635959acf3ba852e125c8098d4160160672a79"} Jul 02 19:03:50.220504 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.220483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvw5b" event={"ID":"19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24","Type":"ContainerStarted","Data":"2ba8d8855439c8ec7a662b06dcf1cf1c53bb4850313e58ac8320eec151ebb309"} Jul 02 19:03:50.221836 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.221810 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qchw" event={"ID":"4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5","Type":"ContainerStarted","Data":"3cd34b15eda50597a4a0d8f883201db59d91e277a4dd43057cabb67a39852d30"} Jul 02 19:03:50.223165 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.223141 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" event={"ID":"44ccf5d2bec11f5aed6f9eee7ef6e2b0","Type":"ContainerStarted","Data":"a28c2ece014b2563a39ffbde0b6befb247bb279954024184e8e1180cb8aebf76"} Jul 02 19:03:50.224437 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.224419 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" event={"ID":"92e3a56c-727f-4d88-85ec-a6a9a811689d","Type":"ContainerStarted","Data":"77c402680fa99f77c2387a6d7e880aa513214537c08c27a82572d5cabf7af76b"} Jul 02 19:03:50.225747 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.225729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" event={"ID":"8cc11cea-4f03-46c2-8e07-cc94593acafa","Type":"ContainerStarted","Data":"d7b2217534dde7824591dbde8c16d6379f85c4201a88db82223b300b80e48e36"} Jul 02 19:03:50.227011 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.226989 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2dmtd" event={"ID":"6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee","Type":"ContainerStarted","Data":"c4b496cb3b8983b0f1593a04e18358a175656b087ce6aa174257a2cea861089f"} Jul 02 19:03:50.229334 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:03:50.229610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229592 2582 generic.go:356] "Generic (PLEG): container finished" podID="500c3995-f510-4cc7-a9b0-ab7abf494118" containerID="2eadd8174513030c33b4e890d9b6778b7c1db1343489b0dd68b9267e4316f709" exitCode=1 Jul 02 19:03:50.229664 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229650 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"b3557d374260b2a377904a4aab01a9cc1390bddc9c4c1e2d1452cccb5722039c"} Jul 02 19:03:50.229724 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229698 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"3bd1f7a26ebbb2469860f9bfcf895abdad1fb97a55c29f95ab30297a773473c7"} Jul 02 19:03:50.229766 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229733 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"65fd5625999878f5a23f31675a5778650632072cfd39d130b795fd4f1333e905"} Jul 02 19:03:50.229822 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"aaa6885a7030dab99b6fa98b951007e0d4c486aec2f9a83a28a6fa987867a0e0"} Jul 02 19:03:50.229874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229839 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerDied","Data":"2eadd8174513030c33b4e890d9b6778b7c1db1343489b0dd68b9267e4316f709"} Jul 02 19:03:50.229874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.229870 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"c4ed8b45d3da3cd37f475d11a1cd53a21f7c7db14808159df7f73644cacc99d1"} Jul 02 19:03:50.231027 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.230869 2582 generic.go:356] "Generic (PLEG): container finished" podID="26cd1bbc-6409-4610-81a2-d0451f36dcad" containerID="1fd5e5c3d187a2c91bbb85a5f7c0f06be5fc26117f802145fbe218e828cf0554" exitCode=0 Jul 02 19:03:50.231093 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.230893 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerDied","Data":"1fd5e5c3d187a2c91bbb85a5f7c0f06be5fc26117f802145fbe218e828cf0554"} Jul 02 19:03:50.232479 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.232462 2582 generic.go:356] "Generic (PLEG): container finished" podID="49289221ee726540fe6b771ca05823b8" containerID="f205cb0ba20fc07c77412285a57de5b3cac2d58a98e1ad819a0c04e09041f373" exitCode=0 Jul 02 19:03:50.232552 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.232493 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" event={"ID":"49289221ee726540fe6b771ca05823b8","Type":"ContainerDied","Data":"f205cb0ba20fc07c77412285a57de5b3cac2d58a98e1ad819a0c04e09041f373"} Jul 02 19:03:50.238235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.238185 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4mn26" podStartSLOduration=2.147824564 podStartE2EDuration="22.238168725s" totalImagesPullingTime="20.090344161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:50.237319114 +0000 UTC m=+22.773076617" watchObservedRunningTime="2026-07-02 19:03:50.238168725 +0000 UTC m=+22.773926227" Jul 02 19:03:50.253560 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.253523 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tkwg8" podStartSLOduration=2.524307816 podStartE2EDuration="22.253511677s" totalImagesPullingTime="19.729203861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:50.253231729 +0000 UTC m=+22.788989230" watchObservedRunningTime="2026-07-02 19:03:50.253511677 +0000 UTC m=+22.789269177" Jul 02 19:03:50.267549 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.267506 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-48.ec2.internal" podStartSLOduration=22.26749553 podStartE2EDuration="22.26749553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:50.267469927 +0000 UTC m=+22.803227447" watchObservedRunningTime="2026-07-02 19:03:50.26749553 +0000 UTC m=+22.803253030" Jul 02 19:03:50.282686 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.282642 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5qchw" podStartSLOduration=2.45640494 podStartE2EDuration="22.282625345s" totalImagesPullingTime="19.826220405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:50.282496687 +0000 UTC m=+22.818254209" watchObservedRunningTime="2026-07-02 19:03:50.282625345 +0000 UTC m=+22.818382850" Jul 02 19:03:50.298150 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.298100 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vvw5b" podStartSLOduration=10.714415586 podStartE2EDuration="22.298084408s" totalImagesPullingTime="11.583668822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:50.29775695 +0000 UTC m=+22.833514473" watchObservedRunningTime="2026-07-02 19:03:50.298084408 +0000 UTC m=+22.833841940" Jul 02 19:03:50.349861 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.349822 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2dmtd" podStartSLOduration=2.607910638 podStartE2EDuration="22.349807584s" totalImagesPullingTime="19.741896946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:50.349473974 +0000 UTC m=+22.885231475" watchObservedRunningTime="2026-07-02 19:03:50.349807584 +0000 UTC m=+22.885565086" Jul 02 19:03:50.480706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.480668 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:50.915201 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.915161 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:50.915909 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:50.915889 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:51.066126 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.066096 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:51.066306 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:51.066208 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:51.235932 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.235863 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" event={"ID":"49289221ee726540fe6b771ca05823b8","Type":"ContainerStarted","Data":"5fa017e454590664c18321a4469b62eaa2dfb7857ca71bbde19fc32375a10822"} Jul 02 19:03:51.236694 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.236668 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:51.236834 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.236721 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2dmtd" Jul 02 19:03:51.252260 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.252219 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-48.ec2.internal" podStartSLOduration=23.252204704 podStartE2EDuration="23.252204704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:51.251586401 +0000 UTC m=+23.787343907" watchObservedRunningTime="2026-07-02 19:03:51.252204704 +0000 UTC m=+23.787962224" Jul 02 19:03:51.266137 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.266084 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nm6hr" podStartSLOduration=3.512322396 podStartE2EDuration="23.266062172s" totalImagesPullingTime="19.753739776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:51.265554644 +0000 UTC m=+23.801312178" watchObservedRunningTime="2026-07-02 19:03:51.266062172 +0000 UTC m=+23.801819675" Jul 02 19:03:51.379538 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.379512 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 19:03:51.386741 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.386699 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:51.463831 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:51.463800 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:52.001900 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.001765 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:03:51.379532497Z","UUID":"c3fe2cd1-69c5-4fe5-92a6-fbb2d2770811","Handler":null,"Name":"","Endpoint":""} Jul 02 19:03:52.003601 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.003573 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 19:03:52.003601 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.003609 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 19:03:52.065714 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.065684 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:52.065892 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:52.065853 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:52.065980 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.065903 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:52.066033 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:52.065988 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:52.241556 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.241468 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" event={"ID":"8cc11cea-4f03-46c2-8e07-cc94593acafa","Type":"ContainerStarted","Data":"7a59090d22ec56be30165be4978035f3cfb994d589bcd088f09da2ba3d565ee0"} Jul 02 19:03:52.247109 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.247086 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:03:52.247720 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:52.247691 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"03603c54e2a15736bdb9ef66f93f334aaac54bbc0db31795f68e81e29805b4d3"} Jul 02 19:03:53.066304 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:53.066270 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:53.066522 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:53.066402 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:53.252846 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:53.252810 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" event={"ID":"8cc11cea-4f03-46c2-8e07-cc94593acafa","Type":"ContainerStarted","Data":"e66fd6abac3f2247f7a89f53d7e5207034ae7cd94e797485f7cfffe6f81a4d9a"} Jul 02 19:03:53.273974 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:53.273921 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7gr4" podStartSLOduration=2.715692185 podStartE2EDuration="25.273905763s" totalImagesPullingTime="22.558213578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:53.272093743 +0000 UTC m=+25.807851270" watchObservedRunningTime="2026-07-02 19:03:53.273905763 +0000 UTC m=+25.809663267" Jul 02 19:03:54.065609 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:54.065571 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:54.065812 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:54.065710 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:54.065812 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:54.065759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:54.065934 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:54.065895 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:54.965281 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:54.965070 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:55.019321 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.019288 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:55.066204 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.066176 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:55.066340 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:55.066268 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:55.260716 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.260643 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:03:55.261015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.260994 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"1facbc9373fac2703b5995b4be67d15ce6557b41f9b40dcc11542c1574d194a8"} Jul 02 19:03:55.261257 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.261227 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:55.261376 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.261302 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:55.261464 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.261448 2582 scope.go:117] "RemoveContainer" containerID="2eadd8174513030c33b4e890d9b6778b7c1db1343489b0dd68b9267e4316f709" Jul 02 19:03:55.279527 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:55.279505 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:56.017974 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.017932 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:56.065863 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.065835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:56.066015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.065832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:56.066015 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:56.066002 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:56.066195 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:56.066147 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:56.115294 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.115260 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:56.268671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.268603 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:03:56.269113 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.269076 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" event={"ID":"500c3995-f510-4cc7-a9b0-ab7abf494118","Type":"ContainerStarted","Data":"50f16d92850942aa8b845391a07104a25187d019d56812efad65390acc537ff3"} Jul 02 19:03:56.269381 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.269356 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:56.287795 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.287575 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:03:56.299274 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.299234 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" podStartSLOduration=8.503311244 podStartE2EDuration="28.299219163s" totalImagesPullingTime="19.795907919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:56.298620426 +0000 UTC m=+28.834377983" watchObservedRunningTime="2026-07-02 19:03:56.299219163 +0000 UTC m=+28.834976677" Jul 02 19:03:56.528995 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.528847 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l552f"] Jul 02 19:03:56.528995 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.528972 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:56.529188 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:56.529068 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:56.532725 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.532701 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdbp6"] Jul 02 19:03:56.532860 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.532819 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:56.532949 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:56.532920 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:56.533522 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.533498 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jnvdh"] Jul 02 19:03:56.533616 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.533606 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:56.533745 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:56.533709 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:56.922098 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:56.922059 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:58.069303 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.069274 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:03:58.069669 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.069361 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:03:58.069669 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:58.069365 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:03:58.069669 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.069394 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:03:58.069669 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:58.069482 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:03:58.069669 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:03:58.069538 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:03:58.276337 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.276256 2582 generic.go:356] "Generic (PLEG): container finished" podID="26cd1bbc-6409-4610-81a2-d0451f36dcad" containerID="6ee1b96b64d675e61df4c78870187ee678a43a44fd9df963d537e8598db9ce46" exitCode=0 Jul 02 19:03:58.276469 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.276341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerDied","Data":"6ee1b96b64d675e61df4c78870187ee678a43a44fd9df963d537e8598db9ce46"} Jul 02 19:03:58.812461 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.812432 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:58.882196 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:58.882162 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:59.280240 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:59.280213 2582 generic.go:356] "Generic (PLEG): container finished" podID="26cd1bbc-6409-4610-81a2-d0451f36dcad" containerID="0155923aa107c12d7521e702a83a5d69439cbcad62eec9610cc3458ca503eaa5" exitCode=0 Jul 02 19:03:59.280517 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:03:59.280266 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerDied","Data":"0155923aa107c12d7521e702a83a5d69439cbcad62eec9610cc3458ca503eaa5"} Jul 02 19:04:00.065691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.065663 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:00.065848 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.065706 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:00.065848 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.065664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:04:00.065848 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.065767 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:04:00.065966 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.065876 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:04:00.066001 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.065953 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:04:00.284667 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.284639 2582 generic.go:356] "Generic (PLEG): container finished" podID="26cd1bbc-6409-4610-81a2-d0451f36dcad" containerID="b445fd6aeed5749fb208f674f9593e16b79101a9ad9a47f225333b8ba241de98" exitCode=0 Jul 02 19:04:00.284957 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.284686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerDied","Data":"b445fd6aeed5749fb208f674f9593e16b79101a9ad9a47f225333b8ba241de98"} Jul 02 19:04:00.618201 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.618167 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:04:00.618362 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.618279 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:04:00.618362 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.618341 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:04:32.618324521 +0000 UTC m=+65.154082014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:04:00.719354 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.719322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:00.719488 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.719438 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:04:00.719488 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.719485 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret podName:2ed2587e-2a26-430f-9c12-42656f301bde nodeName:}" failed. No retries permitted until 2026-07-02 19:04:32.71947283 +0000 UTC m=+65.255230309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret") pod "global-pull-secret-syncer-zdbp6" (UID: "2ed2587e-2a26-430f-9c12-42656f301bde") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:04:00.820478 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:00.820449 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:00.820627 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.820575 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:04:00.820627 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.820587 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:04:00.820627 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.820597 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6d877 for pod openshift-network-diagnostics/network-check-target-l552f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:04:00.820725 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:00.820640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877 podName:cc0585ca-cbd1-40c7-9af7-30d5ead0880f nodeName:}" failed. No retries permitted until 2026-07-02 19:04:32.820628789 +0000 UTC m=+65.356386269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d877" (UniqueName: "kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877") pod "network-check-target-l552f" (UID: "cc0585ca-cbd1-40c7-9af7-30d5ead0880f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:04:02.065939 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:02.065915 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:04:02.066305 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:02.065916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:02.066305 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:02.066022 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnvdh" podUID="3245b487-a7c6-450b-9c8a-0f77f928e6ab" Jul 02 19:04:02.066305 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:02.065916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:02.066305 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:02.066089 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdbp6" podUID="2ed2587e-2a26-430f-9c12-42656f301bde" Jul 02 19:04:02.066305 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:02.066145 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l552f" podUID="cc0585ca-cbd1-40c7-9af7-30d5ead0880f" Jul 02 19:04:03.168629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.168557 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-48.ec2.internal" event="NodeReady" Jul 02 19:04:03.168970 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.168687 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 19:04:03.243979 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.243947 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wtjsf"] Jul 02 19:04:03.247367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.247344 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rqbvc"] Jul 02 19:04:03.247503 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.247483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.250377 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.250355 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 19:04:03.250909 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.250892 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5tjt\"" Jul 02 19:04:03.251188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.251174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.251845 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.251828 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 19:04:03.253696 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.253672 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 19:04:03.254141 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.254125 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mg9mb\"" Jul 02 19:04:03.254396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.254380 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 19:04:03.255328 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.255206 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 19:04:03.270963 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.270946 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqbvc"] Jul 02 19:04:03.274461 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.274440 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wtjsf"] Jul 02 19:04:03.337718 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.337689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v644x\" (UniqueName: \"kubernetes.io/projected/2dc2a90b-4a16-421e-a0d1-35831755f6f0-kube-api-access-v644x\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.337900 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.337728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.337900 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.337849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lx54\" (UniqueName: \"kubernetes.io/projected/4640ed7c-c7ad-4805-9190-332f8ff295c4-kube-api-access-7lx54\") pod \"ingress-canary-rqbvc\" (UID: \"4640ed7c-c7ad-4805-9190-332f8ff295c4\") " pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.337900 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.337886 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4640ed7c-c7ad-4805-9190-332f8ff295c4-cert\") pod \"ingress-canary-rqbvc\" (UID: \"4640ed7c-c7ad-4805-9190-332f8ff295c4\") " pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.338087 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.337920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc2a90b-4a16-421e-a0d1-35831755f6f0-config-volume\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.338087 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.337978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dc2a90b-4a16-421e-a0d1-35831755f6f0-tmp-dir\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.439207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439132 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lx54\" (UniqueName: \"kubernetes.io/projected/4640ed7c-c7ad-4805-9190-332f8ff295c4-kube-api-access-7lx54\") pod \"ingress-canary-rqbvc\" (UID: \"4640ed7c-c7ad-4805-9190-332f8ff295c4\") " pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.439207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4640ed7c-c7ad-4805-9190-332f8ff295c4-cert\") pod \"ingress-canary-rqbvc\" (UID: \"4640ed7c-c7ad-4805-9190-332f8ff295c4\") " pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.439491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc2a90b-4a16-421e-a0d1-35831755f6f0-config-volume\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.439491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dc2a90b-4a16-421e-a0d1-35831755f6f0-tmp-dir\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.439491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439449 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v644x\" (UniqueName: \"kubernetes.io/projected/2dc2a90b-4a16-421e-a0d1-35831755f6f0-kube-api-access-v644x\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.439491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.439723 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:03.439592 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:04:03.439723 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:03.439649 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls podName:2dc2a90b-4a16-421e-a0d1-35831755f6f0 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:03.939632065 +0000 UTC m=+36.475389549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls") pod "dns-default-wtjsf" (UID: "2dc2a90b-4a16-421e-a0d1-35831755f6f0") : secret "dns-default-metrics-tls" not found Jul 02 19:04:03.439723 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439713 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dc2a90b-4a16-421e-a0d1-35831755f6f0-tmp-dir\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.439934 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.439915 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc2a90b-4a16-421e-a0d1-35831755f6f0-config-volume\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.443967 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.443942 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4640ed7c-c7ad-4805-9190-332f8ff295c4-cert\") pod \"ingress-canary-rqbvc\" (UID: \"4640ed7c-c7ad-4805-9190-332f8ff295c4\") " pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.448435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.448391 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lx54\" (UniqueName: \"kubernetes.io/projected/4640ed7c-c7ad-4805-9190-332f8ff295c4-kube-api-access-7lx54\") pod \"ingress-canary-rqbvc\" (UID: \"4640ed7c-c7ad-4805-9190-332f8ff295c4\") " pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.449771 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.449749 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v644x\" (UniqueName: \"kubernetes.io/projected/2dc2a90b-4a16-421e-a0d1-35831755f6f0-kube-api-access-v644x\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.563347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.563316 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqbvc" Jul 02 19:04:03.780745 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.780711 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqbvc"] Jul 02 19:04:03.784896 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:03.784870 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4640ed7c_c7ad_4805_9190_332f8ff295c4.slice/crio-ac7b0acc33e309b8be09a898a4980db10c2cd3b96d5ad6a12ea4f3c67e5e4636 WatchSource:0}: Error finding container ac7b0acc33e309b8be09a898a4980db10c2cd3b96d5ad6a12ea4f3c67e5e4636: Status 404 returned error can't find the container with id ac7b0acc33e309b8be09a898a4980db10c2cd3b96d5ad6a12ea4f3c67e5e4636 Jul 02 19:04:03.943307 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:03.943067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:03.943474 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:03.943209 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:04:03.943533 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:03.943476 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls podName:2dc2a90b-4a16-421e-a0d1-35831755f6f0 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:04.943450843 +0000 UTC m=+37.479208342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls") pod "dns-default-wtjsf" (UID: "2dc2a90b-4a16-421e-a0d1-35831755f6f0") : secret "dns-default-metrics-tls" not found Jul 02 19:04:04.021463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.021390 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:04.066383 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.066356 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:04.066501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.066408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:04.066501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.066421 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:04:04.069516 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.069488 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9s6wg\"" Jul 02 19:04:04.069722 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.069704 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:04:04.069830 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.069727 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:04:04.069830 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.069727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:04:04.070413 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.070392 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:04:04.070702 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.070688 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6qb6\"" Jul 02 19:04:04.080840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.080774 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:04.296259 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.296219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqbvc" event={"ID":"4640ed7c-c7ad-4805-9190-332f8ff295c4","Type":"ContainerStarted","Data":"ac7b0acc33e309b8be09a898a4980db10c2cd3b96d5ad6a12ea4f3c67e5e4636"} Jul 02 19:04:04.951556 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:04.951522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:04.951751 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:04.951647 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:04:04.951751 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:04.951713 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls podName:2dc2a90b-4a16-421e-a0d1-35831755f6f0 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:06.951696005 +0000 UTC m=+39.487453491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls") pod "dns-default-wtjsf" (UID: "2dc2a90b-4a16-421e-a0d1-35831755f6f0") : secret "dns-default-metrics-tls" not found Jul 02 19:04:06.303525 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:06.303488 2582 generic.go:356] "Generic (PLEG): container finished" podID="26cd1bbc-6409-4610-81a2-d0451f36dcad" containerID="894161e886fc9e92dc81362211e8228cccb8ada3141937b7117020e8f8d00b19" exitCode=0 Jul 02 19:04:06.303873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:06.303535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerDied","Data":"894161e886fc9e92dc81362211e8228cccb8ada3141937b7117020e8f8d00b19"} Jul 02 19:04:06.969134 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:06.969101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:06.969291 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:06.969250 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:04:06.969331 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:06.969313 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls podName:2dc2a90b-4a16-421e-a0d1-35831755f6f0 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:10.969298878 +0000 UTC m=+43.505056357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls") pod "dns-default-wtjsf" (UID: "2dc2a90b-4a16-421e-a0d1-35831755f6f0") : secret "dns-default-metrics-tls" not found Jul 02 19:04:07.169851 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:07.169816 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:07.225737 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:07.225660 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:07.308588 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:07.308549 2582 generic.go:356] "Generic (PLEG): container finished" podID="26cd1bbc-6409-4610-81a2-d0451f36dcad" containerID="0bb3c89ddae29eb048c1ec04d374ed4b86c5531031ce493e7220e6fb2793549b" exitCode=0 Jul 02 19:04:07.309148 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:07.308614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerDied","Data":"0bb3c89ddae29eb048c1ec04d374ed4b86c5531031ce493e7220e6fb2793549b"} Jul 02 19:04:08.313533 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:08.313503 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" event={"ID":"26cd1bbc-6409-4610-81a2-d0451f36dcad","Type":"ContainerStarted","Data":"78fffed89a31677bb799418032b1d0d6c548aa3e0d894069dc5feac0b10f51ab"} Jul 02 19:04:08.467792 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:08.467742 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:08.543744 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:08.543708 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:08.620033 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:08.619959 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:09.317417 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:09.317378 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqbvc" event={"ID":"4640ed7c-c7ad-4805-9190-332f8ff295c4","Type":"ContainerStarted","Data":"567afaa4fc28bde63c796d9417ff3c680a3a40f0de4422bf78d69e4305f87541"} Jul 02 19:04:09.335029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:09.334983 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rqbvc" podStartSLOduration=1.467804135 podStartE2EDuration="6.334970007s" totalImagesPullingTime="4.867165872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:09.333241572 +0000 UTC m=+41.868999072" watchObservedRunningTime="2026-07-02 19:04:09.334970007 +0000 UTC m=+41.870727508" Jul 02 19:04:09.335160 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:09.335071 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k8k6v" podStartSLOduration=6.700840501 podStartE2EDuration="41.33506787s" totalImagesPullingTime="34.634227369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:08.341661356 +0000 UTC m=+40.877418859" watchObservedRunningTime="2026-07-02 19:04:09.33506787 +0000 UTC m=+41.870825435" Jul 02 19:04:10.995379 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:10.995289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:10.995727 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:10.995435 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:04:10.995727 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:10.995501 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls podName:2dc2a90b-4a16-421e-a0d1-35831755f6f0 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:18.995484835 +0000 UTC m=+51.531242318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls") pod "dns-default-wtjsf" (UID: "2dc2a90b-4a16-421e-a0d1-35831755f6f0") : secret "dns-default-metrics-tls" not found Jul 02 19:04:12.588927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:12.588886 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:12.663133 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:12.663100 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:13.700588 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.700557 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66b9b55d7-skxpt"] Jul 02 19:04:13.734447 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.734417 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66b9b55d7-skxpt"] Jul 02 19:04:13.734579 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.734509 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.737318 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737288 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 19:04:13.737463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737362 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 19:04:13.737463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737377 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 19:04:13.737463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737408 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 19:04:13.737647 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737631 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 19:04:13.737715 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737702 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f6w8g\"" Jul 02 19:04:13.737817 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.737801 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 19:04:13.808442 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.808407 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj"] Jul 02 19:04:13.817166 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.817134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdkr\" (UniqueName: \"kubernetes.io/projected/b2780353-a8e5-4cdc-92b4-5db22295bc50-kube-api-access-ghdkr\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.817301 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.817208 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.817350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.817325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-default-certificate\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.817404 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.817382 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.817447 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.817405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-stats-auth\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.830235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.830208 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-6hf54"] Jul 02 19:04:13.830350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.830328 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:13.834254 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.834230 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gwh4t\"" Jul 02 19:04:13.834396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.834259 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 19:04:13.834396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.834230 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 19:04:13.835261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.835248 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 19:04:13.836126 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.836109 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 19:04:13.850468 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.850447 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d6ff74d69-jw5tb"] Jul 02 19:04:13.850579 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.850502 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:13.851709 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.851684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:13.852908 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.852891 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 19:04:13.853038 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.853017 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:04:13.853102 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.853029 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l8k2p\"" Jul 02 19:04:13.853472 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.853452 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 19:04:13.853796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.853764 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 19:04:13.863561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.863545 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 19:04:13.877722 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.877705 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj"] Jul 02 19:04:13.877826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.877734 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-6hf54"] Jul 02 19:04:13.877826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.877747 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d6ff74d69-jw5tb"] Jul 02 19:04:13.877902 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.877834 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:13.880444 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.880430 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 19:04:13.880687 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.880672 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 19:04:13.880933 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.880912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n6mp5\"" Jul 02 19:04:13.881027 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.880914 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 19:04:13.886062 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.886043 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 19:04:13.909010 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.908985 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4"] Jul 02 19:04:13.918208 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdkr\" (UniqueName: \"kubernetes.io/projected/b2780353-a8e5-4cdc-92b4-5db22295bc50-kube-api-access-ghdkr\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.918322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:13.918322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8d9\" (UniqueName: \"kubernetes.io/projected/833e3390-fa45-4e04-8918-28a52e92bf18-kube-api-access-rq8d9\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:13.918433 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.918433 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:13.918400 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:04:13.918433 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-default-certificate\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.918566 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:13.918450 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:14.418436699 +0000 UTC m=+46.954194177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : secret "router-metrics-certs-default" not found Jul 02 19:04:13.918566 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.918566 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-stats-auth\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.918566 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.918526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/833e3390-fa45-4e04-8918-28a52e92bf18-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:13.918749 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:13.918640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:14.418626441 +0000 UTC m=+46.954383921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : configmap references non-existent config key: service-ca.crt Jul 02 19:04:13.922679 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.922650 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-default-certificate\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.922775 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.922652 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-stats-auth\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.927685 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.927669 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs"] Jul 02 19:04:13.927841 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.927825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:13.930242 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.930219 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 19:04:13.930350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.930313 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 19:04:13.930406 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.930361 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rcxqw\"" Jul 02 19:04:13.930632 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.930615 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 19:04:13.930721 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.930647 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:04:13.931179 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.931160 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdkr\" (UniqueName: \"kubernetes.io/projected/b2780353-a8e5-4cdc-92b4-5db22295bc50-kube-api-access-ghdkr\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:13.947825 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.947803 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs"] Jul 02 19:04:13.947926 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.947829 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4"] Jul 02 19:04:13.947926 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.947909 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:13.949991 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.949971 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:13.950640 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.950589 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 19:04:13.950722 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.950707 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dwkf6\"" Jul 02 19:04:13.950824 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:13.950808 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 19:04:14.018994 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.018954 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef933343-91a6-46b5-8d95-a7292b85d52a-trusted-ca\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.018994 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.018999 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-ca-trust-extracted\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wb4r\" (UniqueName: \"kubernetes.io/projected/ef933343-91a6-46b5-8d95-a7292b85d52a-kube-api-access-5wb4r\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.019222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:14.019222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019162 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.019222 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.019173 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:14.019222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plths\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-kube-api-access-plths\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.019236 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls podName:833e3390-fa45-4e04-8918-28a52e92bf18 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:14.519214299 +0000 UTC m=+47.054971782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dn2gj" (UID: "833e3390-fa45-4e04-8918-28a52e92bf18") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-image-registry-private-configuration\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-trusted-ca\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019368 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4dkj\" (UniqueName: \"kubernetes.io/projected/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-kube-api-access-k4dkj\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019387 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-installation-pull-secrets\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:14.019441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8d9\" (UniqueName: \"kubernetes.io/projected/833e3390-fa45-4e04-8918-28a52e92bf18-kube-api-access-rq8d9\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019483 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef933343-91a6-46b5-8d95-a7292b85d52a-serving-cert\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-certificates\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/833e3390-fa45-4e04-8918-28a52e92bf18-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-bound-sa-token\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019674 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef933343-91a6-46b5-8d95-a7292b85d52a-config\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.019719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.019689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.020164 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.020144 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/833e3390-fa45-4e04-8918-28a52e92bf18-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:14.027428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.027410 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8d9\" (UniqueName: \"kubernetes.io/projected/833e3390-fa45-4e04-8918-28a52e92bf18-kube-api-access-rq8d9\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:14.120988 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.120956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-image-registry-private-configuration\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.120988 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.120992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-trusted-ca\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.121227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4dkj\" (UniqueName: \"kubernetes.io/projected/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-kube-api-access-k4dkj\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.121227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-installation-pull-secrets\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.121227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:14.121227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:14.121227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef933343-91a6-46b5-8d95-a7292b85d52a-serving-cert\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.121227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-certificates\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-bound-sa-token\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121257 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.121265 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef933343-91a6-46b5-8d95-a7292b85d52a-config\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.121342 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert podName:62d98d53-aaf6-4742-8fc8-9b003ccb3ba4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:14.62132221 +0000 UTC m=+47.157079703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-lwvqs" (UID: "62d98d53-aaf6-4742-8fc8-9b003ccb3ba4") : secret "networking-console-plugin-cert" not found Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef933343-91a6-46b5-8d95-a7292b85d52a-trusted-ca\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.121386 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.121398 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d6ff74d69-jw5tb: secret "image-registry-tls" not found Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-ca-trust-extracted\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.121444 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls podName:d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:14.621430047 +0000 UTC m=+47.157187540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls") pod "image-registry-6d6ff74d69-jw5tb" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3") : secret "image-registry-tls" not found Jul 02 19:04:14.121520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wb4r\" (UniqueName: \"kubernetes.io/projected/ef933343-91a6-46b5-8d95-a7292b85d52a-kube-api-access-5wb4r\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.122103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.122103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plths\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-kube-api-access-plths\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.122103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.121729 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-ca-trust-extracted\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.122103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.122025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:14.122103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.122055 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-certificates\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.122345 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.122144 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-trusted-ca\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.122591 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.122515 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.122680 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.122640 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef933343-91a6-46b5-8d95-a7292b85d52a-config\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.122738 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.122701 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef933343-91a6-46b5-8d95-a7292b85d52a-trusted-ca\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.123704 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.123673 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-installation-pull-secrets\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.123862 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.123842 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef933343-91a6-46b5-8d95-a7292b85d52a-serving-cert\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.124501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.124477 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.124575 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.124540 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-image-registry-private-configuration\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.130050 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.130023 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4dkj\" (UniqueName: \"kubernetes.io/projected/d68bb488-2d5b-4f4e-ace4-5dfac55b2935-kube-api-access-k4dkj\") pod \"kube-storage-version-migrator-operator-846bf668f7-b8fp4\" (UID: \"d68bb488-2d5b-4f4e-ace4-5dfac55b2935\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.130389 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.130370 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plths\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-kube-api-access-plths\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.130888 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.130859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-bound-sa-token\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.131165 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.131149 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wb4r\" (UniqueName: \"kubernetes.io/projected/ef933343-91a6-46b5-8d95-a7292b85d52a-kube-api-access-5wb4r\") pod \"console-operator-68b757fb67-6hf54\" (UID: \"ef933343-91a6-46b5-8d95-a7292b85d52a\") " pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.160162 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.160138 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:14.241648 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.241461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" Jul 02 19:04:14.304306 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.304273 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-6hf54"] Jul 02 19:04:14.307334 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:14.307306 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef933343_91a6_46b5_8d95_a7292b85d52a.slice/crio-2eef36a493a77473c4e7c03f7aa47843a8fcba4be4930289618f7ef679e296d1 WatchSource:0}: Error finding container 2eef36a493a77473c4e7c03f7aa47843a8fcba4be4930289618f7ef679e296d1: Status 404 returned error can't find the container with id 2eef36a493a77473c4e7c03f7aa47843a8fcba4be4930289618f7ef679e296d1 Jul 02 19:04:14.339697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.339622 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" event={"ID":"ef933343-91a6-46b5-8d95-a7292b85d52a","Type":"ContainerStarted","Data":"2eef36a493a77473c4e7c03f7aa47843a8fcba4be4930289618f7ef679e296d1"} Jul 02 19:04:14.399593 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.399557 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4"] Jul 02 19:04:14.403328 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:14.403306 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68bb488_2d5b_4f4e_ace4_5dfac55b2935.slice/crio-84eb85e4b4f60d1a0e9e893db9816647e6411aba1e94ce665cf3ab4fd3514c31 WatchSource:0}: Error finding container 84eb85e4b4f60d1a0e9e893db9816647e6411aba1e94ce665cf3ab4fd3514c31: Status 404 returned error can't find the container with id 84eb85e4b4f60d1a0e9e893db9816647e6411aba1e94ce665cf3ab4fd3514c31 Jul 02 19:04:14.428428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.428401 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:14.428531 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.428449 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:14.428591 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.428538 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:04:14.428645 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.428598 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:15.428577816 +0000 UTC m=+47.964335308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : configmap references non-existent config key: service-ca.crt Jul 02 19:04:14.428645 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.428622 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:15.428611884 +0000 UTC m=+47.964369363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : secret "router-metrics-certs-default" not found Jul 02 19:04:14.529362 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.529297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:14.529472 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.529420 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:14.529472 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.529468 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls podName:833e3390-fa45-4e04-8918-28a52e92bf18 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:15.529456027 +0000 UTC m=+48.065213507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dn2gj" (UID: "833e3390-fa45-4e04-8918-28a52e92bf18") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:14.630569 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.630534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:14.630686 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:14.630591 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:14.630762 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.630685 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:04:14.630762 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.630707 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:04:14.630762 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.630717 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d6ff74d69-jw5tb: secret "image-registry-tls" not found Jul 02 19:04:14.630762 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.630748 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert podName:62d98d53-aaf6-4742-8fc8-9b003ccb3ba4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:15.630733616 +0000 UTC m=+48.166491095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-lwvqs" (UID: "62d98d53-aaf6-4742-8fc8-9b003ccb3ba4") : secret "networking-console-plugin-cert" not found Jul 02 19:04:14.630762 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:14.630765 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls podName:d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:15.630755748 +0000 UTC m=+48.166513227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls") pod "image-registry-6d6ff74d69-jw5tb" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3") : secret "image-registry-tls" not found Jul 02 19:04:15.344698 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.344632 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" event={"ID":"d68bb488-2d5b-4f4e-ace4-5dfac55b2935","Type":"ContainerStarted","Data":"84eb85e4b4f60d1a0e9e893db9816647e6411aba1e94ce665cf3ab4fd3514c31"} Jul 02 19:04:15.437668 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.437632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:15.437851 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.437686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:15.437918 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.437846 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:04:15.437918 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.437873 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:17.437854376 +0000 UTC m=+49.973611855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : configmap references non-existent config key: service-ca.crt Jul 02 19:04:15.437918 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.437910 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:17.437892378 +0000 UTC m=+49.973649864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : secret "router-metrics-certs-default" not found Jul 02 19:04:15.521854 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.521822 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:15.538799 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.538757 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:15.538956 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.538939 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:15.539028 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.539017 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls podName:833e3390-fa45-4e04-8918-28a52e92bf18 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:17.538995742 +0000 UTC m=+50.074753223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dn2gj" (UID: "833e3390-fa45-4e04-8918-28a52e92bf18") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:15.626097 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.625981 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:15.639948 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.639918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:15.640089 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:15.639999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:15.640089 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.640079 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:04:15.640197 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.640143 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert podName:62d98d53-aaf6-4742-8fc8-9b003ccb3ba4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:17.640127539 +0000 UTC m=+50.175885021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-lwvqs" (UID: "62d98d53-aaf6-4742-8fc8-9b003ccb3ba4") : secret "networking-console-plugin-cert" not found Jul 02 19:04:15.640197 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.640174 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:04:15.640197 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.640192 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d6ff74d69-jw5tb: secret "image-registry-tls" not found Jul 02 19:04:15.640350 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:15.640244 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls podName:d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:17.640224493 +0000 UTC m=+50.175981975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls") pod "image-registry-6d6ff74d69-jw5tb" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3") : secret "image-registry-tls" not found Jul 02 19:04:16.661501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:16.661461 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:16.724371 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:16.724326 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:17.454219 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:17.454184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:17.454219 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:17.454233 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:17.454430 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.454356 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:04:17.454430 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.454397 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:21.454382948 +0000 UTC m=+53.990140428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : configmap references non-existent config key: service-ca.crt Jul 02 19:04:17.454430 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.454412 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:21.454406636 +0000 UTC m=+53.990164115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : secret "router-metrics-certs-default" not found Jul 02 19:04:17.555538 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:17.555515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:17.555663 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.555648 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:17.555714 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.555704 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls podName:833e3390-fa45-4e04-8918-28a52e92bf18 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:21.555688693 +0000 UTC m=+54.091446179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dn2gj" (UID: "833e3390-fa45-4e04-8918-28a52e92bf18") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:17.656920 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:17.656893 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:17.657042 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.657023 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:04:17.657042 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.657041 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d6ff74d69-jw5tb: secret "image-registry-tls" not found Jul 02 19:04:17.657154 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:17.657049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:17.657154 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.657092 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls podName:d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:21.657075741 +0000 UTC m=+54.192833221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls") pod "image-registry-6d6ff74d69-jw5tb" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3") : secret "image-registry-tls" not found Jul 02 19:04:17.657267 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.657155 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:04:17.657267 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:17.657206 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert podName:62d98d53-aaf6-4742-8fc8-9b003ccb3ba4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:21.657190588 +0000 UTC m=+54.192948071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-lwvqs" (UID: "62d98d53-aaf6-4742-8fc8-9b003ccb3ba4") : secret "networking-console-plugin-cert" not found Jul 02 19:04:18.353492 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:18.353460 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/0.log" Jul 02 19:04:18.353960 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:18.353509 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef933343-91a6-46b5-8d95-a7292b85d52a" containerID="68ea4982ad10ea966409f3160284315cb7733483221c11136b09b61d8f4e960e" exitCode=255 Jul 02 19:04:18.353960 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:18.353587 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" event={"ID":"ef933343-91a6-46b5-8d95-a7292b85d52a","Type":"ContainerDied","Data":"68ea4982ad10ea966409f3160284315cb7733483221c11136b09b61d8f4e960e"} Jul 02 19:04:18.353960 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:18.353825 2582 scope.go:117] "RemoveContainer" containerID="68ea4982ad10ea966409f3160284315cb7733483221c11136b09b61d8f4e960e" Jul 02 19:04:18.355085 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:18.355062 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" event={"ID":"d68bb488-2d5b-4f4e-ace4-5dfac55b2935","Type":"ContainerStarted","Data":"7f028e732fea712034394d3a59dda8d11f768fdb57ce14978f3210a8ad024e29"} Jul 02 19:04:18.383469 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:18.383421 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" podStartSLOduration=2.260317386 podStartE2EDuration="5.383392997s" totalImagesPullingTime="3.123075611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:18.383242254 +0000 UTC m=+50.918999782" watchObservedRunningTime="2026-07-02 19:04:18.383392997 +0000 UTC m=+50.919150495" Jul 02 19:04:19.071575 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.071535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:19.071755 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:19.071686 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:04:19.071813 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:19.071755 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls podName:2dc2a90b-4a16-421e-a0d1-35831755f6f0 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:35.071737656 +0000 UTC m=+67.607495143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls") pod "dns-default-wtjsf" (UID: "2dc2a90b-4a16-421e-a0d1-35831755f6f0") : secret "dns-default-metrics-tls" not found Jul 02 19:04:19.359407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.359337 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:04:19.359824 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.359752 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/0.log" Jul 02 19:04:19.359824 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.359803 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef933343-91a6-46b5-8d95-a7292b85d52a" containerID="d3a38c0b8bccf1fc7f83c0862dd2e7208635bb1bc42d7f2b8f5e6521a5d98074" exitCode=255 Jul 02 19:04:19.359934 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.359842 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" event={"ID":"ef933343-91a6-46b5-8d95-a7292b85d52a","Type":"ContainerDied","Data":"d3a38c0b8bccf1fc7f83c0862dd2e7208635bb1bc42d7f2b8f5e6521a5d98074"} Jul 02 19:04:19.359934 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.359919 2582 scope.go:117] "RemoveContainer" containerID="68ea4982ad10ea966409f3160284315cb7733483221c11136b09b61d8f4e960e" Jul 02 19:04:19.360111 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:19.360094 2582 scope.go:117] "RemoveContainer" containerID="d3a38c0b8bccf1fc7f83c0862dd2e7208635bb1bc42d7f2b8f5e6521a5d98074" Jul 02 19:04:19.360282 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:19.360263 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-6hf54_openshift-console-operator(ef933343-91a6-46b5-8d95-a7292b85d52a)\"" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" podUID="ef933343-91a6-46b5-8d95-a7292b85d52a" Jul 02 19:04:20.363456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:20.363426 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:04:20.364029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:20.363823 2582 scope.go:117] "RemoveContainer" containerID="d3a38c0b8bccf1fc7f83c0862dd2e7208635bb1bc42d7f2b8f5e6521a5d98074" Jul 02 19:04:20.364103 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:20.364029 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-6hf54_openshift-console-operator(ef933343-91a6-46b5-8d95-a7292b85d52a)\"" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" podUID="ef933343-91a6-46b5-8d95-a7292b85d52a" Jul 02 19:04:20.424308 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:20.424278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:20.516234 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:20.516201 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.097347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.097290 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.197310 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.197276 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.400326 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.400241 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.491698 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.491662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:21.491698 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.491704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:21.492025 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.491857 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.491843318 +0000 UTC m=+62.027600802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : configmap references non-existent config key: service-ca.crt Jul 02 19:04:21.492025 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.491924 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:04:21.492025 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.491988 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.491974652 +0000 UTC m=+62.027732141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : secret "router-metrics-certs-default" not found Jul 02 19:04:21.492594 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.492560 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.592212 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.592185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:21.592352 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.592299 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:21.592396 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.592355 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls podName:833e3390-fa45-4e04-8918-28a52e92bf18 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.592339503 +0000 UTC m=+62.128096982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dn2gj" (UID: "833e3390-fa45-4e04-8918-28a52e92bf18") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:21.592681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.592656 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.692625 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.692552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:21.692751 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.692659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:21.692751 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.692691 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:04:21.692751 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.692706 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d6ff74d69-jw5tb: secret "image-registry-tls" not found Jul 02 19:04:21.692751 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.692748 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:04:21.692928 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.692765 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls podName:d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.692750977 +0000 UTC m=+62.228508455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls") pod "image-registry-6d6ff74d69-jw5tb" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3") : secret "image-registry-tls" not found Jul 02 19:04:21.692928 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.692813 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert podName:62d98d53-aaf6-4742-8fc8-9b003ccb3ba4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.692799925 +0000 UTC m=+62.228557405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-lwvqs" (UID: "62d98d53-aaf6-4742-8fc8-9b003ccb3ba4") : secret "networking-console-plugin-cert" not found Jul 02 19:04:21.735614 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.735585 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-72q8h"] Jul 02 19:04:21.749712 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.749680 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72q8h"] Jul 02 19:04:21.749846 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.749824 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.752273 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.752248 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 19:04:21.752382 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.752255 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 19:04:21.752382 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.752275 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rhh92\"" Jul 02 19:04:21.752629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.752609 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 19:04:21.753323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.753303 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 19:04:21.756854 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.756821 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.828017 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.827991 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.888995 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.888961 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:21.893966 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.893945 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.894059 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.893977 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.894059 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.894031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c3a885a-57ac-481b-bde9-370000fcecad-crio-socket\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.894206 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.894131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz6cz\" (UniqueName: \"kubernetes.io/projected/6c3a885a-57ac-481b-bde9-370000fcecad-kube-api-access-kz6cz\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.894258 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.894211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c3a885a-57ac-481b-bde9-370000fcecad-data-volume\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995466 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c3a885a-57ac-481b-bde9-370000fcecad-crio-socket\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995466 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.995340 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:04:21.995466 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.995413 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:22.495397525 +0000 UTC m=+55.031155005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : configmap "kube-rbac-proxy" not found Jul 02 19:04:21.995466 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.995426 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:04:21.995653 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:21.995482 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:22.495469406 +0000 UTC m=+55.031226888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : secret "insights-runtime-extractor-tls" not found Jul 02 19:04:21.995653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz6cz\" (UniqueName: \"kubernetes.io/projected/6c3a885a-57ac-481b-bde9-370000fcecad-kube-api-access-kz6cz\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995571 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c3a885a-57ac-481b-bde9-370000fcecad-data-volume\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995526 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c3a885a-57ac-481b-bde9-370000fcecad-crio-socket\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:21.995865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:21.995857 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c3a885a-57ac-481b-bde9-370000fcecad-data-volume\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:22.003581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:22.003555 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz6cz\" (UniqueName: \"kubernetes.io/projected/6c3a885a-57ac-481b-bde9-370000fcecad-kube-api-access-kz6cz\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:22.082327 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:22.082298 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:22.182858 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:22.182822 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:22.498567 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:22.498517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:22.498567 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:22.498567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:22.499007 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:22.498633 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:04:22.499007 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:22.498650 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:04:22.499007 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:22.498693 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:23.498677072 +0000 UTC m=+56.034434554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : configmap "kube-rbac-proxy" not found Jul 02 19:04:22.499007 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:22.498719 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:23.498712636 +0000 UTC m=+56.034470114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : secret "insights-runtime-extractor-tls" not found Jul 02 19:04:23.506376 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:23.506342 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:23.506376 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:23.506375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:23.506827 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:23.506457 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:04:23.506827 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:23.506480 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:04:23.506827 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:23.506520 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:25.506502845 +0000 UTC m=+58.042260332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : configmap "kube-rbac-proxy" not found Jul 02 19:04:23.506827 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:23.506534 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:25.506527652 +0000 UTC m=+58.042285130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : secret "insights-runtime-extractor-tls" not found Jul 02 19:04:23.712747 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:23.712713 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:23.770709 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:23.770634 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:24.160594 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:24.160567 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:24.160744 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:24.160610 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:24.160926 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:24.160914 2582 scope.go:117] "RemoveContainer" containerID="d3a38c0b8bccf1fc7f83c0862dd2e7208635bb1bc42d7f2b8f5e6521a5d98074" Jul 02 19:04:24.161067 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:24.161050 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-6hf54_openshift-console-operator(ef933343-91a6-46b5-8d95-a7292b85d52a)\"" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" podUID="ef933343-91a6-46b5-8d95-a7292b85d52a" Jul 02 19:04:24.317477 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:24.317448 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qchw_4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5/dns-node-resolver/0.log" Jul 02 19:04:24.707849 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:24.707806 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:25.523259 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:25.523227 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:25.523259 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:25.523260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:25.523548 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:25.523343 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:04:25.523548 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:25.523357 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:04:25.523548 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:25.523410 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.523395206 +0000 UTC m=+62.059152686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : secret "insights-runtime-extractor-tls" not found Jul 02 19:04:25.523548 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:25.523434 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.523420458 +0000 UTC m=+62.059177936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : configmap "kube-rbac-proxy" not found Jul 02 19:04:25.714969 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:25.714946 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvw5b_19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24/node-ca/0.log" Jul 02 19:04:26.514842 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:26.514811 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqbvc_4640ed7c-c7ad-4805-9190-332f8ff295c4/serve-healthcheck-canary/0.log" Jul 02 19:04:27.116513 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:27.116485 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-b8fp4_d68bb488-2d5b-4f4e-ace4-5dfac55b2935/kube-storage-version-migrator-operator/0.log" Jul 02 19:04:27.891877 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:27.891844 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:27.989129 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:27.989098 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:28.186501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.186426 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:28.290201 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.290177 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8b44h" Jul 02 19:04:28.306604 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.306562 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:28.391220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.391180 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:28.492249 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.492167 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:28.549155 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.549131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:28.890881 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:28.890850 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:29.488198 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.488166 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:29.553681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.553655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:29.553814 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.553686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:29.553814 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.553766 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:04:29.553814 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.553800 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:04:29.553957 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.553843 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:37.553827748 +0000 UTC m=+70.089585226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : configmap "kube-rbac-proxy" not found Jul 02 19:04:29.553957 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.553879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:29.553957 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.553911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:29.553957 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.553944 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:37.553915955 +0000 UTC m=+70.089673451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : secret "insights-runtime-extractor-tls" not found Jul 02 19:04:29.554107 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.553976 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:45.55396399 +0000 UTC m=+78.089721484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : configmap references non-existent config key: service-ca.crt Jul 02 19:04:29.554107 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.553977 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:04:29.554107 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.554020 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs podName:b2780353-a8e5-4cdc-92b4-5db22295bc50 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:45.554007354 +0000 UTC m=+78.089764837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs") pod "router-default-66b9b55d7-skxpt" (UID: "b2780353-a8e5-4cdc-92b4-5db22295bc50") : secret "router-metrics-certs-default" not found Jul 02 19:04:29.654589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.654557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:29.654758 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.654717 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:29.654861 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.654799 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls podName:833e3390-fa45-4e04-8918-28a52e92bf18 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:45.654763989 +0000 UTC m=+78.190521469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dn2gj" (UID: "833e3390-fa45-4e04-8918-28a52e92bf18") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:04:29.755388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.755307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:29.755538 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:29.755398 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:29.755538 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.755459 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:04:29.755538 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.755470 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:04:29.755538 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.755480 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d6ff74d69-jw5tb: secret "image-registry-tls" not found Jul 02 19:04:29.755538 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.755526 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert podName:62d98d53-aaf6-4742-8fc8-9b003ccb3ba4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:45.755513782 +0000 UTC m=+78.291271261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-lwvqs" (UID: "62d98d53-aaf6-4742-8fc8-9b003ccb3ba4") : secret "networking-console-plugin-cert" not found Jul 02 19:04:29.755538 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:29.755540 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls podName:d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:45.75553414 +0000 UTC m=+78.291291618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls") pod "image-registry-6d6ff74d69-jw5tb" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3") : secret "image-registry-tls" not found Jul 02 19:04:30.299077 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:30.299043 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:30.481930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:30.481885 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:30.884849 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:30.884797 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:31.088776 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:31.088742 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:31.496709 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:31.496677 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:31.885408 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:31.885378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:32.081476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.081437 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:32.497089 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.497057 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:32.620103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.620069 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:32.678052 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.678021 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:04:32.680897 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.680878 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:04:32.689050 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:32.689032 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 19:04:32.689135 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:32.689106 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs podName:3245b487-a7c6-450b-9c8a-0f77f928e6ab nodeName:}" failed. No retries permitted until 2026-07-02 19:05:36.689086137 +0000 UTC m=+129.224843617 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs") pod "network-metrics-daemon-jnvdh" (UID: "3245b487-a7c6-450b-9c8a-0f77f928e6ab") : secret "metrics-daemon-secret" not found Jul 02 19:04:32.778919 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.778853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:32.781713 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.781696 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:04:32.792131 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.792113 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ed2587e-2a26-430f-9c12-42656f301bde-original-pull-secret\") pod \"global-pull-secret-syncer-zdbp6\" (UID: \"2ed2587e-2a26-430f-9c12-42656f301bde\") " pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:32.878136 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.878101 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdbp6" Jul 02 19:04:32.882555 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.879718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:32.883005 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.882986 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:04:32.890877 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.890827 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:32.892864 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.892845 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:04:32.903321 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:32.903297 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d877\" (UniqueName: \"kubernetes.io/projected/cc0585ca-cbd1-40c7-9af7-30d5ead0880f-kube-api-access-6d877\") pod \"network-check-target-l552f\" (UID: \"cc0585ca-cbd1-40c7-9af7-30d5ead0880f\") " pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:33.000832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.000805 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdbp6"] Jul 02 19:04:33.003309 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:33.003278 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed2587e_2a26_430f_9c12_42656f301bde.slice/crio-1d86b7f54290a320225757bbdbcf80dc9d95b38818adcc6fd719d775d4d22d7b WatchSource:0}: Error finding container 1d86b7f54290a320225757bbdbcf80dc9d95b38818adcc6fd719d775d4d22d7b: Status 404 returned error can't find the container with id 1d86b7f54290a320225757bbdbcf80dc9d95b38818adcc6fd719d775d4d22d7b Jul 02 19:04:33.186625 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.186601 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6qb6\"" Jul 02 19:04:33.193832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.193808 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:33.290610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.290582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:33.310796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.310753 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l552f"] Jul 02 19:04:33.313185 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:33.313167 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0585ca_cbd1_40c7_9af7_30d5ead0880f.slice/crio-367d9afc4d31d93d31c7ec74b93edda9a7e0b6bc780466412c7b4376eaaf04aa WatchSource:0}: Error finding container 367d9afc4d31d93d31c7ec74b93edda9a7e0b6bc780466412c7b4376eaaf04aa: Status 404 returned error can't find the container with id 367d9afc4d31d93d31c7ec74b93edda9a7e0b6bc780466412c7b4376eaaf04aa Jul 02 19:04:33.391055 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.391005 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:33.395576 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.395548 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdbp6" event={"ID":"2ed2587e-2a26-430f-9c12-42656f301bde","Type":"ContainerStarted","Data":"1d86b7f54290a320225757bbdbcf80dc9d95b38818adcc6fd719d775d4d22d7b"} Jul 02 19:04:33.396522 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.396500 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l552f" event={"ID":"cc0585ca-cbd1-40c7-9af7-30d5ead0880f","Type":"ContainerStarted","Data":"367d9afc4d31d93d31c7ec74b93edda9a7e0b6bc780466412c7b4376eaaf04aa"} Jul 02 19:04:33.601581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.601539 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:33.702347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.702309 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:33.898266 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:33.898159 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:34.277873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:34.277773 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:34.749883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:34.749848 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:34.912823 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:34.912772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:35.100946 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.100908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:35.103721 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.103696 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dc2a90b-4a16-421e-a0d1-35831755f6f0-metrics-tls\") pod \"dns-default-wtjsf\" (UID: \"2dc2a90b-4a16-421e-a0d1-35831755f6f0\") " pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:35.361398 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.361333 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5tjt\"" Jul 02 19:04:35.369252 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.369230 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:35.479651 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.479561 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:35.538225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.538194 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wtjsf"] Jul 02 19:04:35.541268 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:35.541238 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc2a90b_4a16_421e_a0d1_35831755f6f0.slice/crio-7c4f760d7d63cb4f828611384f189ce6da80160de8189c950a8325bef607126d WatchSource:0}: Error finding container 7c4f760d7d63cb4f828611384f189ce6da80160de8189c950a8325bef607126d: Status 404 returned error can't find the container with id 7c4f760d7d63cb4f828611384f189ce6da80160de8189c950a8325bef607126d Jul 02 19:04:35.649617 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.649531 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:35.703399 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.703352 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:35.894128 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:35.894085 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:36.290290 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:36.290254 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:36.406824 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:36.406772 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtjsf" event={"ID":"2dc2a90b-4a16-421e-a0d1-35831755f6f0","Type":"ContainerStarted","Data":"7c4f760d7d63cb4f828611384f189ce6da80160de8189c950a8325bef607126d"} Jul 02 19:04:36.688769 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:36.688624 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:37.412156 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.412116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l552f" event={"ID":"cc0585ca-cbd1-40c7-9af7-30d5ead0880f","Type":"ContainerStarted","Data":"f58e26e68e625c92b642d72db9002b85dfcc46dd41640212041e4e81ea57f3a0"} Jul 02 19:04:37.412631 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.412272 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:04:37.428426 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.428375 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l552f" podStartSLOduration=65.844436197 podStartE2EDuration="1m9.428354558s" totalImagesPullingTime="3.583918361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:37.427861347 +0000 UTC m=+69.963618868" watchObservedRunningTime="2026-07-02 19:04:37.428354558 +0000 UTC m=+69.964112060" Jul 02 19:04:37.487000 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.486963 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:37.623657 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.623622 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:37.623657 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.623660 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:37.623940 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:37.623819 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:04:37.623940 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:04:37.623902 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls podName:6c3a885a-57ac-481b-bde9-370000fcecad nodeName:}" failed. No retries permitted until 2026-07-02 19:04:53.623866955 +0000 UTC m=+86.159624454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72q8h" (UID: "6c3a885a-57ac-481b-bde9-370000fcecad") : secret "insights-runtime-extractor-tls" not found Jul 02 19:04:37.624322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.624292 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c3a885a-57ac-481b-bde9-370000fcecad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:37.892423 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:37.892382 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:38.068319 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:38.068288 2582 scope.go:117] "RemoveContainer" containerID="d3a38c0b8bccf1fc7f83c0862dd2e7208635bb1bc42d7f2b8f5e6521a5d98074" Jul 02 19:04:38.089121 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:38.089077 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:38.283474 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:38.283386 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:38.485453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:38.485413 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:38.884370 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:38.884331 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:39.421283 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.421199 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtjsf" event={"ID":"2dc2a90b-4a16-421e-a0d1-35831755f6f0","Type":"ContainerStarted","Data":"8ea228e95b48451c854b85bddd87d64401720f860350d67cd511c8831a0d9f5e"} Jul 02 19:04:39.421283 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.421252 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtjsf" event={"ID":"2dc2a90b-4a16-421e-a0d1-35831755f6f0","Type":"ContainerStarted","Data":"366f8412b102bdfb12502c9c038de1d78acfd8bac66280221d604d194d26459e"} Jul 02 19:04:39.421494 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.421307 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:39.422685 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.422662 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdbp6" event={"ID":"2ed2587e-2a26-430f-9c12-42656f301bde","Type":"ContainerStarted","Data":"140c0cd82f78e3cc6b964fa80db66fbf5747ecc74c038d185ffd0e0994286f72"} Jul 02 19:04:39.424284 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.424268 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:04:39.424407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.424307 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" event={"ID":"ef933343-91a6-46b5-8d95-a7292b85d52a","Type":"ContainerStarted","Data":"96d557450c42b23367a4623569afae05b0e496b2af5edee6333f45b3c856c05f"} Jul 02 19:04:39.424539 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.424525 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:39.441874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.441831 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wtjsf" podStartSLOduration=32.998112737 podStartE2EDuration="36.441819064s" totalImagesPullingTime="3.443706327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:39.440212059 +0000 UTC m=+71.975969598" watchObservedRunningTime="2026-07-02 19:04:39.441819064 +0000 UTC m=+71.977576564" Jul 02 19:04:39.457847 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.457765 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zdbp6" podStartSLOduration=65.469297832 podStartE2EDuration="1m11.457752256s" totalImagesPullingTime="5.988454424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:39.456895029 +0000 UTC m=+71.992652533" watchObservedRunningTime="2026-07-02 19:04:39.457752256 +0000 UTC m=+71.993509810" Jul 02 19:04:39.473496 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.473455 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" podStartSLOduration=23.260173812 podStartE2EDuration="26.473442101s" totalImagesPullingTime="3.213268289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:39.472314967 +0000 UTC m=+72.008072467" watchObservedRunningTime="2026-07-02 19:04:39.473442101 +0000 UTC m=+72.009199604" Jul 02 19:04:39.653510 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.653485 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-6hf54" Jul 02 19:04:39.715048 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.714953 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:39.773983 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.773944 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:39.881099 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.881066 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:39.983811 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:39.983716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:40.036101 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:40.036076 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:40.149002 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:40.148971 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:40.312373 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:40.312342 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:40.715746 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:40.715662 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:40.819797 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:40.819754 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:40.926032 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:40.926004 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:41.534723 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:41.534690 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:41.636279 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:41.636253 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:41.738619 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:41.738583 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:41.835910 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:41.835875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:45.587564 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.587530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:45.587564 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.587567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:45.588158 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.588140 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2780353-a8e5-4cdc-92b4-5db22295bc50-service-ca-bundle\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:45.589797 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.589764 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2780353-a8e5-4cdc-92b4-5db22295bc50-metrics-certs\") pod \"router-default-66b9b55d7-skxpt\" (UID: \"b2780353-a8e5-4cdc-92b4-5db22295bc50\") " pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:45.688175 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.688141 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:45.690460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.690440 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/833e3390-fa45-4e04-8918-28a52e92bf18-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dn2gj\" (UID: \"833e3390-fa45-4e04-8918-28a52e92bf18\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:45.789242 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.789213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:45.789392 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.789276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:45.791666 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.791640 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"image-registry-6d6ff74d69-jw5tb\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:45.792116 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.792090 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/62d98d53-aaf6-4742-8fc8-9b003ccb3ba4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lwvqs\" (UID: \"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:45.845517 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.845464 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f6w8g\"" Jul 02 19:04:45.853446 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.853429 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:45.941722 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.941699 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gwh4t\"" Jul 02 19:04:45.949680 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.949656 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" Jul 02 19:04:45.976460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.976434 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66b9b55d7-skxpt"] Jul 02 19:04:45.979493 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:45.979469 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2780353_a8e5_4cdc_92b4_5db22295bc50.slice/crio-f77fdc708f7b53549ba1e58dcc304af06401eeecf6c8545f82cc9b3abc434441 WatchSource:0}: Error finding container f77fdc708f7b53549ba1e58dcc304af06401eeecf6c8545f82cc9b3abc434441: Status 404 returned error can't find the container with id f77fdc708f7b53549ba1e58dcc304af06401eeecf6c8545f82cc9b3abc434441 Jul 02 19:04:45.990125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.990102 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n6mp5\"" Jul 02 19:04:45.998808 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:45.998561 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:46.062998 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.062946 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dwkf6\"" Jul 02 19:04:46.068412 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.068382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" Jul 02 19:04:46.087428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.087401 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj"] Jul 02 19:04:46.090667 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:46.090639 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833e3390_fa45_4e04_8918_28a52e92bf18.slice/crio-ee698116e4e1be6d4ffe32b77f5470b9fe0ef2ddb4d5ff5bb078ee71adeb0c6e WatchSource:0}: Error finding container ee698116e4e1be6d4ffe32b77f5470b9fe0ef2ddb4d5ff5bb078ee71adeb0c6e: Status 404 returned error can't find the container with id ee698116e4e1be6d4ffe32b77f5470b9fe0ef2ddb4d5ff5bb078ee71adeb0c6e Jul 02 19:04:46.134829 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.134803 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d6ff74d69-jw5tb"] Jul 02 19:04:46.140249 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:46.140224 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ec4501_4bc6_46f6_ad7d_1ee4f654cba3.slice/crio-44bc12b1908fb631a8529fc2c82ed05d971c66af91434dc3c818469adb2836ef WatchSource:0}: Error finding container 44bc12b1908fb631a8529fc2c82ed05d971c66af91434dc3c818469adb2836ef: Status 404 returned error can't find the container with id 44bc12b1908fb631a8529fc2c82ed05d971c66af91434dc3c818469adb2836ef Jul 02 19:04:46.204023 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.204001 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs"] Jul 02 19:04:46.206442 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:46.206419 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d98d53_aaf6_4742_8fc8_9b003ccb3ba4.slice/crio-237fbf7100297aabca45cd9e6637be101b51dbfae90f22a87d82d9eb2258ff86 WatchSource:0}: Error finding container 237fbf7100297aabca45cd9e6637be101b51dbfae90f22a87d82d9eb2258ff86: Status 404 returned error can't find the container with id 237fbf7100297aabca45cd9e6637be101b51dbfae90f22a87d82d9eb2258ff86 Jul 02 19:04:46.448728 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.448646 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" event={"ID":"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3","Type":"ContainerStarted","Data":"d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118"} Jul 02 19:04:46.448728 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.448698 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" event={"ID":"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3","Type":"ContainerStarted","Data":"44bc12b1908fb631a8529fc2c82ed05d971c66af91434dc3c818469adb2836ef"} Jul 02 19:04:46.448963 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.448808 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:04:46.449875 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.449850 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" event={"ID":"833e3390-fa45-4e04-8918-28a52e92bf18","Type":"ContainerStarted","Data":"ee698116e4e1be6d4ffe32b77f5470b9fe0ef2ddb4d5ff5bb078ee71adeb0c6e"} Jul 02 19:04:46.450934 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.450911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" event={"ID":"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4","Type":"ContainerStarted","Data":"237fbf7100297aabca45cd9e6637be101b51dbfae90f22a87d82d9eb2258ff86"} Jul 02 19:04:46.452299 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.452279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66b9b55d7-skxpt" event={"ID":"b2780353-a8e5-4cdc-92b4-5db22295bc50","Type":"ContainerStarted","Data":"a2e38d7f0215cbfca24cb4abd77e5a446f6ba20539177c51099b10e7b28f0967"} Jul 02 19:04:46.452381 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.452314 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66b9b55d7-skxpt" event={"ID":"b2780353-a8e5-4cdc-92b4-5db22295bc50","Type":"ContainerStarted","Data":"f77fdc708f7b53549ba1e58dcc304af06401eeecf6c8545f82cc9b3abc434441"} Jul 02 19:04:46.469874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.469832 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" podStartSLOduration=33.469819313 podStartE2EDuration="33.469819313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:46.469037339 +0000 UTC m=+79.004794861" watchObservedRunningTime="2026-07-02 19:04:46.469819313 +0000 UTC m=+79.005576813" Jul 02 19:04:46.486477 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.486430 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66b9b55d7-skxpt" podStartSLOduration=33.486416097 podStartE2EDuration="33.486416097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:46.485578075 +0000 UTC m=+79.021335620" watchObservedRunningTime="2026-07-02 19:04:46.486416097 +0000 UTC m=+79.022173651" Jul 02 19:04:46.854706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.854670 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:46.857628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:46.857604 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:47.456326 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.456298 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:47.457722 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.457697 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66b9b55d7-skxpt" Jul 02 19:04:47.533116 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.533075 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d6ff74d69-jw5tb"] Jul 02 19:04:47.589917 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.589885 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c56c48c46-8z9wt"] Jul 02 19:04:47.593923 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.593419 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.594848 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.594814 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-lm7kx"] Jul 02 19:04:47.599103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.599078 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:04:47.601501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.601483 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:04:47.602813 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.602716 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:04:47.604082 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.603151 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kjt6j\"" Jul 02 19:04:47.616398 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.615770 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c56c48c46-8z9wt"] Jul 02 19:04:47.617933 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.617915 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-lm7kx"] Jul 02 19:04:47.639173 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.639101 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:47.704756 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a511ba6-5700-471f-a727-8f860363d650-installation-pull-secrets\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.704889 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrv8\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-kube-api-access-khrv8\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.704889 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a511ba6-5700-471f-a727-8f860363d650-image-registry-private-configuration\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.704889 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-registry-tls\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.705021 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a511ba6-5700-471f-a727-8f860363d650-trusted-ca\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.705021 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-bound-sa-token\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.705021 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.704996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a511ba6-5700-471f-a727-8f860363d650-ca-trust-extracted\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.705128 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.705030 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a511ba6-5700-471f-a727-8f860363d650-registry-certificates\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.705128 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.705060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnpvv\" (UniqueName: \"kubernetes.io/projected/38a1dfa4-7d13-4e36-b26a-a0aeadf70aad-kube-api-access-rnpvv\") pod \"downloads-685bfb5f64-lm7kx\" (UID: \"38a1dfa4-7d13-4e36-b26a-a0aeadf70aad\") " pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:04:47.766147 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.766109 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:47.805723 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a511ba6-5700-471f-a727-8f860363d650-installation-pull-secrets\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.805857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrv8\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-kube-api-access-khrv8\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.805857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805814 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a511ba6-5700-471f-a727-8f860363d650-image-registry-private-configuration\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.805857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-registry-tls\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.806015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a511ba6-5700-471f-a727-8f860363d650-trusted-ca\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.806015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-bound-sa-token\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.806015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805940 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a511ba6-5700-471f-a727-8f860363d650-ca-trust-extracted\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.806015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.805993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a511ba6-5700-471f-a727-8f860363d650-registry-certificates\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.806244 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.806036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnpvv\" (UniqueName: \"kubernetes.io/projected/38a1dfa4-7d13-4e36-b26a-a0aeadf70aad-kube-api-access-rnpvv\") pod \"downloads-685bfb5f64-lm7kx\" (UID: \"38a1dfa4-7d13-4e36-b26a-a0aeadf70aad\") " pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:04:47.806690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.806660 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a511ba6-5700-471f-a727-8f860363d650-ca-trust-extracted\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.807130 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.807096 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a511ba6-5700-471f-a727-8f860363d650-registry-certificates\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.807250 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.807212 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a511ba6-5700-471f-a727-8f860363d650-trusted-ca\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.808494 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.808471 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a511ba6-5700-471f-a727-8f860363d650-installation-pull-secrets\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.808605 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.808580 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-registry-tls\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.808653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.808618 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a511ba6-5700-471f-a727-8f860363d650-image-registry-private-configuration\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.815291 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.815243 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrv8\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-kube-api-access-khrv8\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.816001 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.815977 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a511ba6-5700-471f-a727-8f860363d650-bound-sa-token\") pod \"image-registry-7c56c48c46-8z9wt\" (UID: \"1a511ba6-5700-471f-a727-8f860363d650\") " pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.816753 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.816729 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnpvv\" (UniqueName: \"kubernetes.io/projected/38a1dfa4-7d13-4e36-b26a-a0aeadf70aad-kube-api-access-rnpvv\") pod \"downloads-685bfb5f64-lm7kx\" (UID: \"38a1dfa4-7d13-4e36-b26a-a0aeadf70aad\") " pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:04:47.907447 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.907413 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:47.926298 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:47.926270 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:04:48.396249 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.396216 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c56c48c46-8z9wt"] Jul 02 19:04:48.400224 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:48.400199 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a511ba6_5700_471f_a727_8f860363d650.slice/crio-c33ccb402e6223e94c0fed93b115dc77643c9b3ceb752913b96ab8dd46a423a0 WatchSource:0}: Error finding container c33ccb402e6223e94c0fed93b115dc77643c9b3ceb752913b96ab8dd46a423a0: Status 404 returned error can't find the container with id c33ccb402e6223e94c0fed93b115dc77643c9b3ceb752913b96ab8dd46a423a0 Jul 02 19:04:48.407807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.407756 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-lm7kx"] Jul 02 19:04:48.411294 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:48.411265 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a1dfa4_7d13_4e36_b26a_a0aeadf70aad.slice/crio-edb52a686156894a5d07f0935631f682fef2bab5e1e7a6604d6f04b9c4cae000 WatchSource:0}: Error finding container edb52a686156894a5d07f0935631f682fef2bab5e1e7a6604d6f04b9c4cae000: Status 404 returned error can't find the container with id edb52a686156894a5d07f0935631f682fef2bab5e1e7a6604d6f04b9c4cae000 Jul 02 19:04:48.462700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.462591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" event={"ID":"62d98d53-aaf6-4742-8fc8-9b003ccb3ba4","Type":"ContainerStarted","Data":"180c7d8fbe173ce7f2a4d58fc58101ac22d36192175fb1c703bb492bfb20d69b"} Jul 02 19:04:48.464381 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.464358 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" event={"ID":"1a511ba6-5700-471f-a727-8f860363d650","Type":"ContainerStarted","Data":"f09a93f8ddfe26af9fc06bc38a32238d80369855b23163dcae286fdd9b781ad1"} Jul 02 19:04:48.464490 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.464399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" event={"ID":"1a511ba6-5700-471f-a727-8f860363d650","Type":"ContainerStarted","Data":"c33ccb402e6223e94c0fed93b115dc77643c9b3ceb752913b96ab8dd46a423a0"} Jul 02 19:04:48.465961 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.465934 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" event={"ID":"833e3390-fa45-4e04-8918-28a52e92bf18","Type":"ContainerStarted","Data":"954724d6fd253025b5c1df9f980e34c0a3ed2545a22b734407aab90253135444"} Jul 02 19:04:48.467314 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.467295 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-lm7kx" event={"ID":"38a1dfa4-7d13-4e36-b26a-a0aeadf70aad","Type":"ContainerStarted","Data":"edb52a686156894a5d07f0935631f682fef2bab5e1e7a6604d6f04b9c4cae000"} Jul 02 19:04:48.477379 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.477323 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lwvqs" podStartSLOduration=34.082570557 podStartE2EDuration="35.477305453s" totalImagesPullingTime="1.394734896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:48.476055559 +0000 UTC m=+81.011813061" watchObservedRunningTime="2026-07-02 19:04:48.477305453 +0000 UTC m=+81.013062936" Jul 02 19:04:48.608873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.608827 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:48.702526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.702476 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:48.826358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:48.826323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:49.150792 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.150758 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:49.328039 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.328000 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:49.428717 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.428625 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:49.430287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.430242 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wtjsf" Jul 02 19:04:49.447317 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.447275 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dn2gj" podStartSLOduration=34.245553656 podStartE2EDuration="36.447258556s" totalImagesPullingTime="2.2017049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:48.512733814 +0000 UTC m=+81.048491309" watchObservedRunningTime="2026-07-02 19:04:49.447258556 +0000 UTC m=+81.983016056" Jul 02 19:04:49.471471 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.471275 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:04:49.492258 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.492211 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" podStartSLOduration=2.492192531 podStartE2EDuration="2.492192531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:49.490796958 +0000 UTC m=+82.026554459" watchObservedRunningTime="2026-07-02 19:04:49.492192531 +0000 UTC m=+82.027950033" Jul 02 19:04:49.498701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.498665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:49.935167 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:49.935108 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:50.035950 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:50.035913 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:52.744452 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:52.744404 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:52.845031 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:52.844991 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:53.651686 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:53.651656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:53.654275 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:53.654212 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c3a885a-57ac-481b-bde9-370000fcecad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72q8h\" (UID: \"6c3a885a-57ac-481b-bde9-370000fcecad\") " pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:53.862739 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:53.862706 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rhh92\"" Jul 02 19:04:53.869950 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:53.869924 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72q8h" Jul 02 19:04:54.024915 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:54.024776 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72q8h"] Jul 02 19:04:54.029995 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:54.029959 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3a885a_57ac_481b_bde9_370000fcecad.slice/crio-1dde0f6522b986e3a0c2e10c2742f837bdd5e131522c6ec5f9a4710d0bff6421 WatchSource:0}: Error finding container 1dde0f6522b986e3a0c2e10c2742f837bdd5e131522c6ec5f9a4710d0bff6421: Status 404 returned error can't find the container with id 1dde0f6522b986e3a0c2e10c2742f837bdd5e131522c6ec5f9a4710d0bff6421 Jul 02 19:04:54.494690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:54.494656 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72q8h" event={"ID":"6c3a885a-57ac-481b-bde9-370000fcecad","Type":"ContainerStarted","Data":"1dde0f6522b986e3a0c2e10c2742f837bdd5e131522c6ec5f9a4710d0bff6421"} Jul 02 19:04:54.837685 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:54.837614 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:54.919703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:54.919662 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:55.020501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:55.020461 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:56.347463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.347432 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6778d48787-rxwlv"] Jul 02 19:04:56.360136 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.360107 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6778d48787-rxwlv"] Jul 02 19:04:56.360281 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.360220 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.363331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.363086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:04:56.363331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.363139 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:04:56.364512 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.363912 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:04:56.364512 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.363928 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:04:56.364512 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.364171 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:04:56.364512 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.364360 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7hzvs\"" Jul 02 19:04:56.477588 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.477553 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-serving-cert\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.477766 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.477629 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lk84\" (UniqueName: \"kubernetes.io/projected/eb70c4d6-68b2-40c4-89d4-bf873bc34462-kube-api-access-5lk84\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.477766 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.477714 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-oauth-serving-cert\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.477766 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.477743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-config\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.477948 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.477770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-service-ca\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.477948 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.477856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-oauth-config\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.578940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.578803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-serving-cert\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.578940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.578894 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lk84\" (UniqueName: \"kubernetes.io/projected/eb70c4d6-68b2-40c4-89d4-bf873bc34462-kube-api-access-5lk84\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.578940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.578948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-oauth-serving-cert\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.579235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.578979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-config\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.579235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.579002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-service-ca\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.579235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.579038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-oauth-config\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.579880 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.579851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-oauth-serving-cert\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.580025 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.579852 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-config\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.580147 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.580119 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-service-ca\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.581998 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.581957 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-serving-cert\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.582430 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.582388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-oauth-config\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.588385 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.588301 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lk84\" (UniqueName: \"kubernetes.io/projected/eb70c4d6-68b2-40c4-89d4-bf873bc34462-kube-api-access-5lk84\") pod \"console-6778d48787-rxwlv\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:56.674078 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:56.673952 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:04:58.346087 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:58.346060 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6778d48787-rxwlv"] Jul 02 19:04:58.350254 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:04:58.350225 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb70c4d6_68b2_40c4_89d4_bf873bc34462.slice/crio-48a01d36a29a119b58e3b03ee78ef26eddcf92641cebf8a8b4ffb9dd31150603 WatchSource:0}: Error finding container 48a01d36a29a119b58e3b03ee78ef26eddcf92641cebf8a8b4ffb9dd31150603: Status 404 returned error can't find the container with id 48a01d36a29a119b58e3b03ee78ef26eddcf92641cebf8a8b4ffb9dd31150603 Jul 02 19:04:58.513891 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:58.512344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6778d48787-rxwlv" event={"ID":"eb70c4d6-68b2-40c4-89d4-bf873bc34462","Type":"ContainerStarted","Data":"48a01d36a29a119b58e3b03ee78ef26eddcf92641cebf8a8b4ffb9dd31150603"} Jul 02 19:04:58.514261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:58.514220 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72q8h" event={"ID":"6c3a885a-57ac-481b-bde9-370000fcecad","Type":"ContainerStarted","Data":"3c5f02094300d409d07086229538dfa6dd906b5ad00534c67ab6784cf349d1b9"} Jul 02 19:04:58.547120 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:58.547082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:58.603011 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:58.602973 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:59.140424 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:59.140390 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:59.347229 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:59.347181 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:59.416895 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:59.416797 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:04:59.520803 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:04:59.520754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72q8h" event={"ID":"6c3a885a-57ac-481b-bde9-370000fcecad","Type":"ContainerStarted","Data":"456eb1aa2a36bb19a0e5618ee31783185ae67447370f363196850d7f4f109f2e"} Jul 02 19:05:00.986751 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:00.986717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.110036 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.109970 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.265569 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.265486 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm"] Jul 02 19:05:01.269008 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.268987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.272324 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.272257 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:05:01.272436 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.272393 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 19:05:01.273492 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.273464 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bbxbb\"" Jul 02 19:05:01.273602 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.273530 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 19:05:01.279710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.279634 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.280083 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.280065 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66"] Jul 02 19:05:01.283150 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.283131 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.285732 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.285714 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 19:05:01.285849 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.285817 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 19:05:01.285912 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.285856 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:05:01.285991 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.285968 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rkrv8\"" Jul 02 19:05:01.296993 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.296415 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm"] Jul 02 19:05:01.297890 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.297869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66"] Jul 02 19:05:01.313943 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.313917 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-27b8g"] Jul 02 19:05:01.317588 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.317568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.320241 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.320217 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 19:05:01.320455 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.320437 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 19:05:01.320551 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.320439 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gbb56\"" Jul 02 19:05:01.320675 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.320654 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 19:05:01.376552 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.376520 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.425539 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.425693 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-textfile\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.425693 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-tls\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.425693 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-wtmp\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.425874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.425874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425769 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcphk\" (UniqueName: \"kubernetes.io/projected/307b76c1-2e80-4ef7-8a46-3e6de9313048-kube-api-access-xcphk\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.425874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9bf7321-f371-4a1c-b842-bffeee1061d6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.425874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307b76c1-2e80-4ef7-8a46-3e6de9313048-metrics-client-ca\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.426049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3e84b10-f7ac-4a83-8703-9b4167095d6e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.426049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-root\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.426049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3e84b10-f7ac-4a83-8703-9b4167095d6e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.426049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.425980 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf7321-f371-4a1c-b842-bffeee1061d6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.426049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9rsm\" (UniqueName: \"kubernetes.io/projected/c3e84b10-f7ac-4a83-8703-9b4167095d6e-kube-api-access-w9rsm\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.426276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw6rx\" (UniqueName: \"kubernetes.io/projected/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-api-access-qw6rx\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.426276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426157 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-accelerators-collector-config\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.426276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.426276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-sys\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.426276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3e84b10-f7ac-4a83-8703-9b4167095d6e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.426276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.426272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.451945 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.451916 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.527070 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.526982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-sys\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527070 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3e84b10-f7ac-4a83-8703-9b4167095d6e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-sys\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527168 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527233 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-textfile\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527273 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-tls\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-wtmp\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527381 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcphk\" (UniqueName: \"kubernetes.io/projected/307b76c1-2e80-4ef7-8a46-3e6de9313048-kube-api-access-xcphk\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9bf7321-f371-4a1c-b842-bffeee1061d6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527458 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307b76c1-2e80-4ef7-8a46-3e6de9313048-metrics-client-ca\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3e84b10-f7ac-4a83-8703-9b4167095d6e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527538 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-root\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3e84b10-f7ac-4a83-8703-9b4167095d6e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf7321-f371-4a1c-b842-bffeee1061d6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527646 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9rsm\" (UniqueName: \"kubernetes.io/projected/c3e84b10-f7ac-4a83-8703-9b4167095d6e-kube-api-access-w9rsm\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.527691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527682 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw6rx\" (UniqueName: \"kubernetes.io/projected/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-api-access-qw6rx\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.528140 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-accelerators-collector-config\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.528140 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.528140 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527937 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-textfile\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.528140 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527955 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-wtmp\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.528140 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527989 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.530821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.530089 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3e84b10-f7ac-4a83-8703-9b4167095d6e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.530821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.529312 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9bf7321-f371-4a1c-b842-bffeee1061d6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.530821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.527938 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9bf7321-f371-4a1c-b842-bffeee1061d6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.530821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.529534 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-accelerators-collector-config\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.530821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.529964 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.533013 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.531206 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/307b76c1-2e80-4ef7-8a46-3e6de9313048-node-exporter-tls\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.533013 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.531369 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/307b76c1-2e80-4ef7-8a46-3e6de9313048-root\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.533013 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.532099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/307b76c1-2e80-4ef7-8a46-3e6de9313048-metrics-client-ca\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.533225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.533064 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3e84b10-f7ac-4a83-8703-9b4167095d6e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.534130 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.533594 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.536867 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.536847 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcphk\" (UniqueName: \"kubernetes.io/projected/307b76c1-2e80-4ef7-8a46-3e6de9313048-kube-api-access-xcphk\") pod \"node-exporter-27b8g\" (UID: \"307b76c1-2e80-4ef7-8a46-3e6de9313048\") " pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.537023 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.536845 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw6rx\" (UniqueName: \"kubernetes.io/projected/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-api-access-qw6rx\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.537280 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.537204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3e84b10-f7ac-4a83-8703-9b4167095d6e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.538107 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.538087 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9bf7321-f371-4a1c-b842-bffeee1061d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-s5k66\" (UID: \"c9bf7321-f371-4a1c-b842-bffeee1061d6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.538194 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.538174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9rsm\" (UniqueName: \"kubernetes.io/projected/c3e84b10-f7ac-4a83-8703-9b4167095d6e-kube-api-access-w9rsm\") pod \"openshift-state-metrics-54cf96dfcf-4gmvm\" (UID: \"c3e84b10-f7ac-4a83-8703-9b4167095d6e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.549046 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.548909 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.579981 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.579956 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" Jul 02 19:05:01.593376 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.593352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" Jul 02 19:05:01.628169 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.628143 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-27b8g" Jul 02 19:05:01.651986 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.651963 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:01.805022 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:01.804983 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:02.244595 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:02.244487 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:02.327178 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:02.327140 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:02.666062 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:02.666030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:03.165293 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.165255 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:03.243698 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.243627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:03.245078 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.245052 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67844cb486-wfqd2"] Jul 02 19:05:03.249139 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.249118 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.252230 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.252149 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 19:05:03.252230 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.252235 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kvhhr\"" Jul 02 19:05:03.252519 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.252497 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 19:05:03.252602 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.252531 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 19:05:03.253306 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.253287 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 19:05:03.253306 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.253287 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 19:05:03.253480 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.253318 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5585tfcq7gnlf\"" Jul 02 19:05:03.260989 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.260967 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67844cb486-wfqd2"] Jul 02 19:05:03.342748 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.342716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49016bde-37e0-4215-9b2f-f558ed80cc5e-metrics-client-ca\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.342935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.342761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.342935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.342800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-grpc-tls\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.342935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.342878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.342935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.342927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-tls\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.343158 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.342974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.343158 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.343003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd22p\" (UniqueName: \"kubernetes.io/projected/49016bde-37e0-4215-9b2f-f558ed80cc5e-kube-api-access-dd22p\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.343158 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.343034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.443837 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.443748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49016bde-37e0-4215-9b2f-f558ed80cc5e-metrics-client-ca\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444007 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.443836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444007 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.443863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-grpc-tls\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444007 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.443929 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444007 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.443956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-tls\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.444009 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.444036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd22p\" (UniqueName: \"kubernetes.io/projected/49016bde-37e0-4215-9b2f-f558ed80cc5e-kube-api-access-dd22p\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.444080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.444661 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.444631 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49016bde-37e0-4215-9b2f-f558ed80cc5e-metrics-client-ca\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.447470 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.447423 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.447566 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.447479 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.447718 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.447697 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-tls\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.447767 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.447707 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.447905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.447889 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-grpc-tls\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.448319 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.448298 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49016bde-37e0-4215-9b2f-f558ed80cc5e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.452554 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.452531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd22p\" (UniqueName: \"kubernetes.io/projected/49016bde-37e0-4215-9b2f-f558ed80cc5e-kube-api-access-dd22p\") pod \"thanos-querier-67844cb486-wfqd2\" (UID: \"49016bde-37e0-4215-9b2f-f558ed80cc5e\") " pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:03.560851 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:03.560820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:04.207093 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:04.207055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:04.307595 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:04.307552 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:04.408576 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:04.408524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:05.010302 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:05.010259 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:06.006083 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.006041 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:06.105733 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.105638 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:06.273329 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.273295 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:06.499751 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.499662 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59f9cff5d-vz27n"] Jul 02 19:05:06.578986 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.578954 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f9cff5d-vz27n"] Jul 02 19:05:06.579161 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.579117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.581979 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.581956 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 19:05:06.582106 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.582087 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 19:05:06.582182 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.582113 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9jf6k\"" Jul 02 19:05:06.582666 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.582467 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 19:05:06.582666 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.582479 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 19:05:06.582666 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.582531 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 19:05:06.587157 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.587130 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 19:05:06.673930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.673893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-federate-client-tls\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674105 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.673959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-serving-certs-ca-bundle\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674105 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.673995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-telemeter-client-tls\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674105 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.674022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-secret-telemeter-client\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674105 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.674084 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-metrics-client-ca\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.674133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.674153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cklq4\" (UniqueName: \"kubernetes.io/projected/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-kube-api-access-cklq4\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.674322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.674278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775272 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-federate-client-tls\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-serving-certs-ca-bundle\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-telemeter-client-tls\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-secret-telemeter-client\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-metrics-client-ca\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.775600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.775545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cklq4\" (UniqueName: \"kubernetes.io/projected/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-kube-api-access-cklq4\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.776359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.776331 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-serving-certs-ca-bundle\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.776459 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.776381 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.776973 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.776927 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-metrics-client-ca\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.778838 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.778776 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.779024 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.778997 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-telemeter-client-tls\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.779024 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.779016 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-secret-telemeter-client\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.779464 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.779441 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-federate-client-tls\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.784866 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.784840 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cklq4\" (UniqueName: \"kubernetes.io/projected/3922f714-c6f6-4a3c-b4cd-f4d72349ac69-kube-api-access-cklq4\") pod \"telemeter-client-59f9cff5d-vz27n\" (UID: \"3922f714-c6f6-4a3c-b4cd-f4d72349ac69\") " pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:06.891620 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:06.891587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" Jul 02 19:05:07.524397 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:07.524361 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:08.418464 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:08.418433 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l552f" Jul 02 19:05:08.474395 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:08.474357 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:05:09.805527 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.804824 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:09.838584 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.838549 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6778d48787-rxwlv"] Jul 02 19:05:09.919819 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.919774 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54d88868d5-zpg7t"] Jul 02 19:05:09.925672 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.925649 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:09.936465 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.936203 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 19:05:09.938987 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.938315 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d88868d5-zpg7t"] Jul 02 19:05:09.944135 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.944081 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:09.996400 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:09.996359 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66"] Jul 02 19:05:10.107460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7chs\" (UniqueName: \"kubernetes.io/projected/ce713255-a2e4-449b-8352-f9ba949df93d-kube-api-access-w7chs\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.107615 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-serving-cert\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.107615 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-trusted-ca-bundle\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.107758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-console-config\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.107758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-oauth-config\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.107758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-oauth-serving-cert\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.107758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.107747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-service-ca\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.208879 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.208802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-console-config\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.208879 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.208851 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-oauth-config\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.209087 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.208925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-oauth-serving-cert\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.209087 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.208982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-service-ca\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.209192 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.209095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7chs\" (UniqueName: \"kubernetes.io/projected/ce713255-a2e4-449b-8352-f9ba949df93d-kube-api-access-w7chs\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.209192 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.209129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-serving-cert\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.209192 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.209160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-trusted-ca-bundle\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.210004 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.209979 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-console-config\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.210203 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.210139 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-trusted-ca-bundle\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.210203 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.210142 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-service-ca\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.210203 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.209990 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-oauth-serving-cert\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.212267 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.212244 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-oauth-config\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.212376 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.212343 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-serving-cert\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.224754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.224733 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7chs\" (UniqueName: \"kubernetes.io/projected/ce713255-a2e4-449b-8352-f9ba949df93d-kube-api-access-w7chs\") pod \"console-54d88868d5-zpg7t\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.229704 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.229683 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm"] Jul 02 19:05:10.232281 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:05:10.232243 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e84b10_f7ac_4a83_8703_9b4167095d6e.slice/crio-1a79dad550dcd2bf6b64d91863356b7f60688cc28bef1e81293b3a0a1e47644a WatchSource:0}: Error finding container 1a79dad550dcd2bf6b64d91863356b7f60688cc28bef1e81293b3a0a1e47644a: Status 404 returned error can't find the container with id 1a79dad550dcd2bf6b64d91863356b7f60688cc28bef1e81293b3a0a1e47644a Jul 02 19:05:10.240552 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.240528 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:10.241915 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.241886 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f9cff5d-vz27n"] Jul 02 19:05:10.243567 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.243479 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67844cb486-wfqd2"] Jul 02 19:05:10.246805 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:05:10.246763 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49016bde_37e0_4215_9b2f_f558ed80cc5e.slice/crio-4110e2422ca925cbd8786f7f3878f70a7b861dc2ae4ee84aea1c2604a1b2d453 WatchSource:0}: Error finding container 4110e2422ca925cbd8786f7f3878f70a7b861dc2ae4ee84aea1c2604a1b2d453: Status 404 returned error can't find the container with id 4110e2422ca925cbd8786f7f3878f70a7b861dc2ae4ee84aea1c2604a1b2d453 Jul 02 19:05:10.252728 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:05:10.252702 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3922f714_c6f6_4a3c_b4cd_f4d72349ac69.slice/crio-1219b12f9bc739a8f46c3d4a487bcfb64fcd825053b82bf4ff12a71e5f853aeb WatchSource:0}: Error finding container 1219b12f9bc739a8f46c3d4a487bcfb64fcd825053b82bf4ff12a71e5f853aeb: Status 404 returned error can't find the container with id 1219b12f9bc739a8f46c3d4a487bcfb64fcd825053b82bf4ff12a71e5f853aeb Jul 02 19:05:10.431154 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.431052 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d88868d5-zpg7t"] Jul 02 19:05:10.486322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.482344 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c56c48c46-8z9wt" Jul 02 19:05:10.568705 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.568602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"4110e2422ca925cbd8786f7f3878f70a7b861dc2ae4ee84aea1c2604a1b2d453"} Jul 02 19:05:10.570994 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.570925 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" event={"ID":"c9bf7321-f371-4a1c-b842-bffeee1061d6","Type":"ContainerStarted","Data":"e171e0e3b5d0cab7456f97c4b84eb2d6bcec7aa18b72a3f27eb1a87c50154f6f"} Jul 02 19:05:10.573284 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.572962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-lm7kx" event={"ID":"38a1dfa4-7d13-4e36-b26a-a0aeadf70aad","Type":"ContainerStarted","Data":"2a164849284e9f048af1e9cbf0e8b1dbf7eb00221876e5ca0deb24203df96950"} Jul 02 19:05:10.575657 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.575426 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:05:10.577773 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.577737 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6778d48787-rxwlv" event={"ID":"eb70c4d6-68b2-40c4-89d4-bf873bc34462","Type":"ContainerStarted","Data":"480c038c7591388abaf91bfea1b64d49ddde2fecc8c7a792a6807a0390ce669a"} Jul 02 19:05:10.580159 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.580123 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-lm7kx" Jul 02 19:05:10.586959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.586891 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72q8h" event={"ID":"6c3a885a-57ac-481b-bde9-370000fcecad","Type":"ContainerStarted","Data":"72c0a6e9c14a04c8799cc903eb560ce3c3e06bea8add010b94b46bfe6676d1b9"} Jul 02 19:05:10.592698 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.592168 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d88868d5-zpg7t" event={"ID":"ce713255-a2e4-449b-8352-f9ba949df93d","Type":"ContainerStarted","Data":"b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a"} Jul 02 19:05:10.592698 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.592208 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d88868d5-zpg7t" event={"ID":"ce713255-a2e4-449b-8352-f9ba949df93d","Type":"ContainerStarted","Data":"79727450fdeccaa1c7e66d504b327d458fcefe5d8aa88a9dbb9eda26366a6348"} Jul 02 19:05:10.599332 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.599309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" event={"ID":"c3e84b10-f7ac-4a83-8703-9b4167095d6e","Type":"ContainerStarted","Data":"a436f8ba57b63901d9af0d8ba66a34d16dadc58bce533562afc1e0a047568d35"} Jul 02 19:05:10.599830 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.599811 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" event={"ID":"c3e84b10-f7ac-4a83-8703-9b4167095d6e","Type":"ContainerStarted","Data":"4b3551ee381a4c12820221d67d9c4a9f0d004636c88cc347ef9485a2ef8c9e44"} Jul 02 19:05:10.599996 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.599935 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-lm7kx" podStartSLOduration=2.221071371 podStartE2EDuration="23.599915181s" totalImagesPullingTime="21.37884381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:10.599601282 +0000 UTC m=+103.135358785" watchObservedRunningTime="2026-07-02 19:05:10.599915181 +0000 UTC m=+103.135672683" Jul 02 19:05:10.600868 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.600808 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" event={"ID":"c3e84b10-f7ac-4a83-8703-9b4167095d6e","Type":"ContainerStarted","Data":"1a79dad550dcd2bf6b64d91863356b7f60688cc28bef1e81293b3a0a1e47644a"} Jul 02 19:05:10.603319 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.603246 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" event={"ID":"3922f714-c6f6-4a3c-b4cd-f4d72349ac69","Type":"ContainerStarted","Data":"1219b12f9bc739a8f46c3d4a487bcfb64fcd825053b82bf4ff12a71e5f853aeb"} Jul 02 19:05:10.606963 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.606203 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-27b8g" event={"ID":"307b76c1-2e80-4ef7-8a46-3e6de9313048","Type":"ContainerStarted","Data":"1376dc289afdb57e8ce31f904b43351ea567a686f04da4f0eb1270f99853d80a"} Jul 02 19:05:10.622693 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.622637 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6778d48787-rxwlv" podStartSLOduration=3.168037338 podStartE2EDuration="14.62261723s" totalImagesPullingTime="11.454579892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:10.621184634 +0000 UTC m=+103.156942147" watchObservedRunningTime="2026-07-02 19:05:10.62261723 +0000 UTC m=+103.158374738" Jul 02 19:05:10.643460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.643404 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-72q8h" podStartSLOduration=34.03701405 podStartE2EDuration="49.643382947s" totalImagesPullingTime="15.606368897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:04:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:10.641273247 +0000 UTC m=+103.177030770" watchObservedRunningTime="2026-07-02 19:05:10.643382947 +0000 UTC m=+103.179140471" Jul 02 19:05:10.647301 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.647275 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:10.684384 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.684323 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54d88868d5-zpg7t" podStartSLOduration=1.684301414 podStartE2EDuration="1.684301414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:10.682539499 +0000 UTC m=+103.218297025" watchObservedRunningTime="2026-07-02 19:05:10.684301414 +0000 UTC m=+103.220058906" Jul 02 19:05:10.746421 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.746327 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:10.952916 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:10.952840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:11.029149 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:11.029064 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:11.171412 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:11.170891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:11.272312 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:11.272148 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:11.436248 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:11.436203 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:11.516362 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:11.516167 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:13.030998 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:13.030962 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:13.117060 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:13.117028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:13.487697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:13.487657 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" podUID="d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" containerName="registry" containerID="cri-o://d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118" gracePeriod=30 Jul 02 19:05:13.799931 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:13.799811 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:13.873112 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:13.873081 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:15.001883 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.001852 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:15.085695 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.085385 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:05:15.102285 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.101213 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163145 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-ca-trust-extracted\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163226 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-trusted-ca\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163278 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163356 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-image-registry-private-configuration\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163410 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plths\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-kube-api-access-plths\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163512 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-installation-pull-secrets\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163557 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-bound-sa-token\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.163587 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-certificates\") pod \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\" (UID: \"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3\") " Jul 02 19:05:15.164905 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.164712 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:15.168853 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.168807 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:15.181733 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.179884 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:05:15.181733 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.180612 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:05:15.181733 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.180820 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:05:15.181733 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.180956 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-kube-api-access-plths" (OuterVolumeSpecName: "kube-api-access-plths") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "kube-api-access-plths". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:05:15.183891 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.183849 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:05:15.200008 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.199979 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" (UID: "d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265335 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-trusted-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265366 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-tls\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265382 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-image-registry-private-configuration\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265397 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plths\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-kube-api-access-plths\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265412 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-installation-pull-secrets\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265426 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-bound-sa-token\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265440 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-registry-certificates\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.266438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.265455 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3-ca-trust-extracted\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:15.632639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.632603 2582 generic.go:356] "Generic (PLEG): container finished" podID="307b76c1-2e80-4ef7-8a46-3e6de9313048" containerID="246a6e021aaf96780f706409367f2f06a246fc9315d724e59488dfc09c3edae6" exitCode=0 Jul 02 19:05:15.632858 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.632697 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-27b8g" event={"ID":"307b76c1-2e80-4ef7-8a46-3e6de9313048","Type":"ContainerDied","Data":"246a6e021aaf96780f706409367f2f06a246fc9315d724e59488dfc09c3edae6"} Jul 02 19:05:15.635750 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.635700 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"639ef3810b76ce821a71b30679c3cea9d63eb37799b17737271aaa5fefa41b77"} Jul 02 19:05:15.635995 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.635967 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"cb629cf9cf9964fef47e6cce6b353c141fbdbc492e6deac661cca8ce4cb5ac18"} Jul 02 19:05:15.636105 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.636031 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"8c5f5e1ae4adb6675988ef76d1450c599b07ee66c46f9504051f04e5d8e18e02"} Jul 02 19:05:15.638304 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.638278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" event={"ID":"c9bf7321-f371-4a1c-b842-bffeee1061d6","Type":"ContainerStarted","Data":"bf174dafe498ac63cb7eef06e1661116c09200c342b0bc3c348d3b067188adb9"} Jul 02 19:05:15.638406 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.638337 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" event={"ID":"c9bf7321-f371-4a1c-b842-bffeee1061d6","Type":"ContainerStarted","Data":"d63d7dcacfe7824f7e49e5b00db36ca73ebf9f99ba19986147adf516c32a5ebb"} Jul 02 19:05:15.638406 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.638369 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" event={"ID":"c9bf7321-f371-4a1c-b842-bffeee1061d6","Type":"ContainerStarted","Data":"efb10d9f960a85d0d43d02db6bf6bec0076a67ff4a4e3680df422f952121a97d"} Jul 02 19:05:15.639677 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.639657 2582 generic.go:356] "Generic (PLEG): container finished" podID="d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" containerID="d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118" exitCode=0 Jul 02 19:05:15.639807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.639697 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" Jul 02 19:05:15.639807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.639739 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" event={"ID":"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3","Type":"ContainerDied","Data":"d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118"} Jul 02 19:05:15.639807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.639802 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d6ff74d69-jw5tb" event={"ID":"d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3","Type":"ContainerDied","Data":"44bc12b1908fb631a8529fc2c82ed05d971c66af91434dc3c818469adb2836ef"} Jul 02 19:05:15.639949 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.639814 2582 scope.go:117] "RemoveContainer" containerID="d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118" Jul 02 19:05:15.642279 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.642254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" event={"ID":"c3e84b10-f7ac-4a83-8703-9b4167095d6e","Type":"ContainerStarted","Data":"b9be80b7efe8c5a6f4a57b359d74119cca45b1c098edfd74dcd67b371deab899"} Jul 02 19:05:15.644564 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.644540 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" event={"ID":"3922f714-c6f6-4a3c-b4cd-f4d72349ac69","Type":"ContainerStarted","Data":"4527121da12e1e5b3978f5cf9f3e8903ad61f2a15a5af86638bce828a93cfd06"} Jul 02 19:05:15.651134 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.651003 2582 scope.go:117] "RemoveContainer" containerID="d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118" Jul 02 19:05:15.651380 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:05:15.651352 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118\": container with ID starting with d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118 not found: ID does not exist" containerID="d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118" Jul 02 19:05:15.651561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.651523 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118"} err="failed to get container status \"d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118\": rpc error: code = NotFound desc = could not find container \"d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118\": container with ID starting with d7ef900fe29f7b8128a6b8bedbc4b719895a09590980bb04d43cf5e5af72e118 not found: ID does not exist" Jul 02 19:05:15.667829 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.667775 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d6ff74d69-jw5tb"] Jul 02 19:05:15.669390 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.669365 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d6ff74d69-jw5tb"] Jul 02 19:05:15.686603 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.685795 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4gmvm" podStartSLOduration=10.189213991999999 podStartE2EDuration="14.685762961s" totalImagesPullingTime="4.496548969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:15.685514243 +0000 UTC m=+108.221271789" watchObservedRunningTime="2026-07-02 19:05:15.685762961 +0000 UTC m=+108.221520464" Jul 02 19:05:15.708933 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:15.708881 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-s5k66" podStartSLOduration=9.814439766 podStartE2EDuration="14.708863653s" totalImagesPullingTime="4.894423887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:15.707029674 +0000 UTC m=+108.242787242" watchObservedRunningTime="2026-07-02 19:05:15.708863653 +0000 UTC m=+108.244621154" Jul 02 19:05:16.073659 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.073619 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" path="/var/lib/kubelet/pods/d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3/volumes" Jul 02 19:05:16.522526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.522441 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:16.621757 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.621718 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:16.654550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.654471 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-27b8g" event={"ID":"307b76c1-2e80-4ef7-8a46-3e6de9313048","Type":"ContainerStarted","Data":"a94859a9c493cc7554feb9e5d637e00c042acedcc8a75c9d8489b64b9affe7cb"} Jul 02 19:05:16.655225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.654815 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-27b8g" event={"ID":"307b76c1-2e80-4ef7-8a46-3e6de9313048","Type":"ContainerStarted","Data":"0cb185a9bbdc1432c95ec85a62355a99318380cb62385ce5f407d9c691d65fb6"} Jul 02 19:05:16.674612 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.674511 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:05:16.678676 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:16.678547 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-27b8g" podStartSLOduration=10.42246624 podStartE2EDuration="15.678528552s" totalImagesPullingTime="5.08624274s" totalInitContainerRuntime="169.819572ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:16.677585138 +0000 UTC m=+109.213342620" watchObservedRunningTime="2026-07-02 19:05:16.678528552 +0000 UTC m=+109.214286054" Jul 02 19:05:17.221767 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:17.221721 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:17.324232 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:17.324176 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:17.661994 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:17.661964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"2b0bd959adb87a4988286e4e9bf92cde66202f4268a0dd20bf1e09557b55efdd"} Jul 02 19:05:17.664430 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:17.664400 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" event={"ID":"3922f714-c6f6-4a3c-b4cd-f4d72349ac69","Type":"ContainerStarted","Data":"9d8e96338d419e5958368bb128a8b987c55bcf446dcb6906c3d600944c671875"} Jul 02 19:05:18.672229 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:18.672182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" event={"ID":"3922f714-c6f6-4a3c-b4cd-f4d72349ac69","Type":"ContainerStarted","Data":"649298ef53705633dd71442d4712414dfdf8dda4674285a4012c3218bfe20044"} Jul 02 19:05:18.675689 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:18.675648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"1c6e0be828200d85a82828798f2021eaedd62c598d10baf68e101f9f0e6d740d"} Jul 02 19:05:18.675874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:18.675725 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" event={"ID":"49016bde-37e0-4215-9b2f-f558ed80cc5e","Type":"ContainerStarted","Data":"e49641234e3b8c89c00cd7a64917e72cd38a817739c440ee14ed4bd65433841b"} Jul 02 19:05:18.675874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:18.675773 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:18.696209 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:18.696152 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59f9cff5d-vz27n" podStartSLOduration=5.7921701930000005 podStartE2EDuration="12.696136165s" totalImagesPullingTime="6.903965972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:18.694997014 +0000 UTC m=+111.230754546" watchObservedRunningTime="2026-07-02 19:05:18.696136165 +0000 UTC m=+111.231893665" Jul 02 19:05:18.716331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:18.716271 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" podStartSLOduration=9.088954449 podStartE2EDuration="15.716249052s" totalImagesPullingTime="6.627294603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:18.713909394 +0000 UTC m=+111.249666920" watchObservedRunningTime="2026-07-02 19:05:18.716249052 +0000 UTC m=+111.252006555" Jul 02 19:05:19.486378 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.486340 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d88868d5-zpg7t"] Jul 02 19:05:19.534327 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.534297 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8568595cdc-7xdhn"] Jul 02 19:05:19.534611 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.534593 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" containerName="registry" Jul 02 19:05:19.534611 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.534608 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" containerName="registry" Jul 02 19:05:19.534806 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.534655 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ec4501-4bc6-46f6-ad7d-1ee4f654cba3" containerName="registry" Jul 02 19:05:19.553083 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.553057 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8568595cdc-7xdhn"] Jul 02 19:05:19.553183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.553147 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.613857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.613817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-trusted-ca-bundle\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.614025 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.613867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-config\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.614025 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.613915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-oauth-serving-cert\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.614025 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.613998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-service-ca\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.614183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.614042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-serving-cert\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.614183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.614124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-795tf\" (UniqueName: \"kubernetes.io/projected/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-kube-api-access-795tf\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.614183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.614153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-oauth-config\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.714913 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.714870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-serving-cert\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.715323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.714938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-795tf\" (UniqueName: \"kubernetes.io/projected/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-kube-api-access-795tf\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.715323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.715146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-oauth-config\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.715323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.715226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-trusted-ca-bundle\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.715323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.715296 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-config\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.715580 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.715414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-oauth-serving-cert\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.715639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.715606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-service-ca\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.716396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.716279 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-service-ca\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.716524 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.716399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-oauth-serving-cert\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.716524 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.716490 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-config\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.716631 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.716488 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-trusted-ca-bundle\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.717644 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.717621 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-serving-cert\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.718540 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.718520 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-oauth-config\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.724103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.724083 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-795tf\" (UniqueName: \"kubernetes.io/projected/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-kube-api-access-795tf\") pod \"console-8568595cdc-7xdhn\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:19.862160 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:19.862129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:20.031475 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.031447 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8568595cdc-7xdhn"] Jul 02 19:05:20.034702 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:05:20.034678 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf4d5fe_5426_43b2_ac3f_d3dc6b4cd464.slice/crio-ffd56055a68323f978695da2383afbb0c0690e9b655dabcb54d0ffe67f666dd6 WatchSource:0}: Error finding container ffd56055a68323f978695da2383afbb0c0690e9b655dabcb54d0ffe67f666dd6: Status 404 returned error can't find the container with id ffd56055a68323f978695da2383afbb0c0690e9b655dabcb54d0ffe67f666dd6 Jul 02 19:05:20.049977 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.049954 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:20.241029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.240986 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:20.247986 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.247959 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:20.582640 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.582604 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:20.683859 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.683799 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:20.685922 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.685896 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8568595cdc-7xdhn" event={"ID":"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464","Type":"ContainerStarted","Data":"b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210"} Jul 02 19:05:20.686041 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.685942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8568595cdc-7xdhn" event={"ID":"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464","Type":"ContainerStarted","Data":"ffd56055a68323f978695da2383afbb0c0690e9b655dabcb54d0ffe67f666dd6"} Jul 02 19:05:20.705870 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:20.705821 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8568595cdc-7xdhn" podStartSLOduration=1.705803665 podStartE2EDuration="1.705803665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:20.704609948 +0000 UTC m=+113.240367507" watchObservedRunningTime="2026-07-02 19:05:20.705803665 +0000 UTC m=+113.241561157" Jul 02 19:05:21.269645 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:21.269611 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:21.371225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:21.371186 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:22.871590 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:22.871555 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:22.931051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:22.931019 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:24.686987 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:24.686955 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67844cb486-wfqd2" Jul 02 19:05:24.717567 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:24.717521 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:24.817159 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:24.817124 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:29.862251 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:29.862215 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:29.862644 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:29.862274 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:29.867268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:29.867240 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:30.732841 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:30.732809 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:05:30.945502 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:30.945469 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:31.047460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:31.047423 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:31.121575 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:31.121500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:35.612513 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:35.612474 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6778d48787-rxwlv" podUID="eb70c4d6-68b2-40c4-89d4-bf873bc34462" containerName="console" containerID="cri-o://480c038c7591388abaf91bfea1b64d49ddde2fecc8c7a792a6807a0390ce669a" gracePeriod=15 Jul 02 19:05:35.748510 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:35.748482 2582 generic.go:356] "Generic (PLEG): container finished" podID="eb70c4d6-68b2-40c4-89d4-bf873bc34462" containerID="480c038c7591388abaf91bfea1b64d49ddde2fecc8c7a792a6807a0390ce669a" exitCode=0 Jul 02 19:05:35.748635 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:35.748528 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6778d48787-rxwlv" event={"ID":"eb70c4d6-68b2-40c4-89d4-bf873bc34462","Type":"ContainerDied","Data":"480c038c7591388abaf91bfea1b64d49ddde2fecc8c7a792a6807a0390ce669a"} Jul 02 19:05:35.901315 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:35.901230 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:05:36.070395 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070364 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-oauth-config\") pod \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " Jul 02 19:05:36.070395 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070397 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-serving-cert\") pod \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " Jul 02 19:05:36.070610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070461 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lk84\" (UniqueName: \"kubernetes.io/projected/eb70c4d6-68b2-40c4-89d4-bf873bc34462-kube-api-access-5lk84\") pod \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " Jul 02 19:05:36.070610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070488 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-config\") pod \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " Jul 02 19:05:36.070610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070543 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-service-ca\") pod \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " Jul 02 19:05:36.070610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070585 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-oauth-serving-cert\") pod \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\" (UID: \"eb70c4d6-68b2-40c4-89d4-bf873bc34462\") " Jul 02 19:05:36.071025 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.070994 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb70c4d6-68b2-40c4-89d4-bf873bc34462" (UID: "eb70c4d6-68b2-40c4-89d4-bf873bc34462"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:36.071139 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.071016 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-config" (OuterVolumeSpecName: "console-config") pod "eb70c4d6-68b2-40c4-89d4-bf873bc34462" (UID: "eb70c4d6-68b2-40c4-89d4-bf873bc34462"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:36.071139 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.071065 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb70c4d6-68b2-40c4-89d4-bf873bc34462" (UID: "eb70c4d6-68b2-40c4-89d4-bf873bc34462"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:36.071356 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.071336 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-oauth-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:36.071396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.071365 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:36.071396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.071381 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb70c4d6-68b2-40c4-89d4-bf873bc34462-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:36.072870 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.072847 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb70c4d6-68b2-40c4-89d4-bf873bc34462" (UID: "eb70c4d6-68b2-40c4-89d4-bf873bc34462"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:05:36.072870 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.072861 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb70c4d6-68b2-40c4-89d4-bf873bc34462-kube-api-access-5lk84" (OuterVolumeSpecName: "kube-api-access-5lk84") pod "eb70c4d6-68b2-40c4-89d4-bf873bc34462" (UID: "eb70c4d6-68b2-40c4-89d4-bf873bc34462"). InnerVolumeSpecName "kube-api-access-5lk84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:05:36.073037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.072909 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb70c4d6-68b2-40c4-89d4-bf873bc34462" (UID: "eb70c4d6-68b2-40c4-89d4-bf873bc34462"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:05:36.172898 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.172809 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:36.172898 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.172842 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lk84\" (UniqueName: \"kubernetes.io/projected/eb70c4d6-68b2-40c4-89d4-bf873bc34462-kube-api-access-5lk84\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:36.172898 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.172853 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb70c4d6-68b2-40c4-89d4-bf873bc34462-console-oauth-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:36.754121 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.754089 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6778d48787-rxwlv" Jul 02 19:05:36.754121 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.754113 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6778d48787-rxwlv" event={"ID":"eb70c4d6-68b2-40c4-89d4-bf873bc34462","Type":"ContainerDied","Data":"48a01d36a29a119b58e3b03ee78ef26eddcf92641cebf8a8b4ffb9dd31150603"} Jul 02 19:05:36.754650 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.754168 2582 scope.go:117] "RemoveContainer" containerID="480c038c7591388abaf91bfea1b64d49ddde2fecc8c7a792a6807a0390ce669a" Jul 02 19:05:36.774338 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.774307 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6778d48787-rxwlv"] Jul 02 19:05:36.778169 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.778110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:05:36.780228 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.780207 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6778d48787-rxwlv"] Jul 02 19:05:36.780554 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.780533 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3245b487-a7c6-450b-9c8a-0f77f928e6ab-metrics-certs\") pod \"network-metrics-daemon-jnvdh\" (UID: \"3245b487-a7c6-450b-9c8a-0f77f928e6ab\") " pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:05:36.790993 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.790973 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9s6wg\"" Jul 02 19:05:36.799023 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.799002 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnvdh" Jul 02 19:05:36.957696 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:36.957670 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jnvdh"] Jul 02 19:05:36.960459 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:05:36.960435 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3245b487_a7c6_450b_9c8a_0f77f928e6ab.slice/crio-206c6a91318ed95cd32a84d684f9262293c3ab41ddff826d4f648e40ddfe050f WatchSource:0}: Error finding container 206c6a91318ed95cd32a84d684f9262293c3ab41ddff826d4f648e40ddfe050f: Status 404 returned error can't find the container with id 206c6a91318ed95cd32a84d684f9262293c3ab41ddff826d4f648e40ddfe050f Jul 02 19:05:37.759678 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:37.759633 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jnvdh" event={"ID":"3245b487-a7c6-450b-9c8a-0f77f928e6ab","Type":"ContainerStarted","Data":"206c6a91318ed95cd32a84d684f9262293c3ab41ddff826d4f648e40ddfe050f"} Jul 02 19:05:38.071911 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:38.071877 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb70c4d6-68b2-40c4-89d4-bf873bc34462" path="/var/lib/kubelet/pods/eb70c4d6-68b2-40c4-89d4-bf873bc34462/volumes" Jul 02 19:05:38.766185 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:38.766162 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jnvdh" event={"ID":"3245b487-a7c6-450b-9c8a-0f77f928e6ab","Type":"ContainerStarted","Data":"35ff9e242caa34d7cb4adcb230c4633cf3409fa3fb7dd2a4393cad2b27357408"} Jul 02 19:05:39.771452 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:39.771417 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jnvdh" event={"ID":"3245b487-a7c6-450b-9c8a-0f77f928e6ab","Type":"ContainerStarted","Data":"2a16610695939915dcfd524aa73114ee1373fb5d1bde08f3d11774f8a1da6b53"} Jul 02 19:05:39.805309 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:39.805257 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jnvdh" podStartSLOduration=130.234065371 podStartE2EDuration="2m11.805242674s" totalImagesPullingTime="1.571177303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:39.804132131 +0000 UTC m=+132.339889659" watchObservedRunningTime="2026-07-02 19:05:39.805242674 +0000 UTC m=+132.341000175" Jul 02 19:05:39.816659 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:39.816625 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:39.944586 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:39.944550 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:40.071743 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:40.071706 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:40.172021 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:40.171990 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:42.830632 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:42.830604 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66b9b55d7-skxpt_b2780353-a8e5-4cdc-92b4-5db22295bc50/router/0.log" Jul 02 19:05:42.852840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:42.852816 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqbvc_4640ed7c-c7ad-4805-9190-332f8ff295c4/serve-healthcheck-canary/0.log" Jul 02 19:05:43.788386 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:43.788363 2582 generic.go:356] "Generic (PLEG): container finished" podID="d68bb488-2d5b-4f4e-ace4-5dfac55b2935" containerID="7f028e732fea712034394d3a59dda8d11f768fdb57ce14978f3210a8ad024e29" exitCode=0 Jul 02 19:05:43.788539 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:43.788401 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" event={"ID":"d68bb488-2d5b-4f4e-ace4-5dfac55b2935","Type":"ContainerDied","Data":"7f028e732fea712034394d3a59dda8d11f768fdb57ce14978f3210a8ad024e29"} Jul 02 19:05:43.788720 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:43.788707 2582 scope.go:117] "RemoveContainer" containerID="7f028e732fea712034394d3a59dda8d11f768fdb57ce14978f3210a8ad024e29" Jul 02 19:05:44.507822 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.507763 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54d88868d5-zpg7t" podUID="ce713255-a2e4-449b-8352-f9ba949df93d" containerName="console" containerID="cri-o://b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a" gracePeriod=15 Jul 02 19:05:44.783987 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.783916 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:44.793373 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.793342 2582 generic.go:356] "Generic (PLEG): container finished" podID="ce713255-a2e4-449b-8352-f9ba949df93d" containerID="b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a" exitCode=0 Jul 02 19:05:44.793546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.793381 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d88868d5-zpg7t" Jul 02 19:05:44.793546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.793425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d88868d5-zpg7t" event={"ID":"ce713255-a2e4-449b-8352-f9ba949df93d","Type":"ContainerDied","Data":"b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a"} Jul 02 19:05:44.793546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.793468 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d88868d5-zpg7t" event={"ID":"ce713255-a2e4-449b-8352-f9ba949df93d","Type":"ContainerDied","Data":"79727450fdeccaa1c7e66d504b327d458fcefe5d8aa88a9dbb9eda26366a6348"} Jul 02 19:05:44.793546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.793490 2582 scope.go:117] "RemoveContainer" containerID="b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a" Jul 02 19:05:44.795251 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.795228 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b8fp4" event={"ID":"d68bb488-2d5b-4f4e-ace4-5dfac55b2935","Type":"ContainerStarted","Data":"a7cada768921e2fd58780c876f5750e28ca355d1bf8fd945b6f51c974facb214"} Jul 02 19:05:44.801365 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.801349 2582 scope.go:117] "RemoveContainer" containerID="b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a" Jul 02 19:05:44.801603 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:05:44.801585 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a\": container with ID starting with b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a not found: ID does not exist" containerID="b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a" Jul 02 19:05:44.801653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.801612 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a"} err="failed to get container status \"b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a\": rpc error: code = NotFound desc = could not find container \"b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a\": container with ID starting with b2e3069330d4d02bff9cf27431cb5ea3add302e22edf2503eff9d06f6b33d36a not found: ID does not exist" Jul 02 19:05:44.947336 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947300 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-trusted-ca-bundle\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947336 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947343 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-oauth-serving-cert\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947371 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-service-ca\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947401 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-console-config\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947429 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7chs\" (UniqueName: \"kubernetes.io/projected/ce713255-a2e4-449b-8352-f9ba949df93d-kube-api-access-w7chs\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947512 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-serving-cert\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947540 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-oauth-config\") pod \"ce713255-a2e4-449b-8352-f9ba949df93d\" (UID: \"ce713255-a2e4-449b-8352-f9ba949df93d\") " Jul 02 19:05:44.947873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947723 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:44.947932 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947869 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-console-config" (OuterVolumeSpecName: "console-config") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:44.947932 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947877 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-oauth-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:44.947932 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.947880 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:44.948287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.948265 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:05:44.949876 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.949751 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce713255-a2e4-449b-8352-f9ba949df93d-kube-api-access-w7chs" (OuterVolumeSpecName: "kube-api-access-w7chs") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "kube-api-access-w7chs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:05:44.949876 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.949798 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:05:44.949876 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:44.949840 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ce713255-a2e4-449b-8352-f9ba949df93d" (UID: "ce713255-a2e4-449b-8352-f9ba949df93d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:05:45.048681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.048648 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:45.048681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.048676 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-console-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:45.048681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.048685 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7chs\" (UniqueName: \"kubernetes.io/projected/ce713255-a2e4-449b-8352-f9ba949df93d-kube-api-access-w7chs\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:45.048922 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.048699 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:45.048922 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.048723 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce713255-a2e4-449b-8352-f9ba949df93d-console-oauth-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:45.048922 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.048736 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce713255-a2e4-449b-8352-f9ba949df93d-trusted-ca-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:05:45.117987 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.117955 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d88868d5-zpg7t"] Jul 02 19:05:45.123137 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:45.123114 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54d88868d5-zpg7t"] Jul 02 19:05:46.070310 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:46.070275 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce713255-a2e4-449b-8352-f9ba949df93d" path="/var/lib/kubelet/pods/ce713255-a2e4-449b-8352-f9ba949df93d/volumes" Jul 02 19:05:46.260603 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:46.260572 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:46.361093 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:46.360998 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:46.461609 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:05:46.461576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:17.352256 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:17.352223 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:17.410483 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:17.410447 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:23.177276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177187 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:06:23.177710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177612 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb70c4d6-68b2-40c4-89d4-bf873bc34462" containerName="console" Jul 02 19:06:23.177710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177629 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb70c4d6-68b2-40c4-89d4-bf873bc34462" containerName="console" Jul 02 19:06:23.177710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177646 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce713255-a2e4-449b-8352-f9ba949df93d" containerName="console" Jul 02 19:06:23.177710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177656 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce713255-a2e4-449b-8352-f9ba949df93d" containerName="console" Jul 02 19:06:23.177959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177758 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb70c4d6-68b2-40c4-89d4-bf873bc34462" containerName="console" Jul 02 19:06:23.177959 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.177775 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce713255-a2e4-449b-8352-f9ba949df93d" containerName="console" Jul 02 19:06:23.180493 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.180472 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.183427 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183407 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 19:06:23.183531 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183501 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 19:06:23.183597 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183567 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 19:06:23.183706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183679 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 19:06:23.183825 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183775 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 19:06:23.183983 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183958 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 19:06:23.184075 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.183997 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 19:06:23.184761 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.184747 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 19:06:23.185011 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.184997 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xxf4s\"" Jul 02 19:06:23.194535 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.194515 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 19:06:23.201377 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.201358 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:06:23.244966 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.244944 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-config-volume\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.244966 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.244972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dfb69c2-a468-4992-b474-657e1f154757-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245095 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.244993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245095 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dfb69c2-a468-4992-b474-657e1f154757-config-out\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245095 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245066 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245095 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0dfb69c2-a468-4992-b474-657e1f154757-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dfb69c2-a468-4992-b474-657e1f154757-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btvzq\" (UniqueName: \"kubernetes.io/projected/0dfb69c2-a468-4992-b474-657e1f154757-kube-api-access-btvzq\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-web-config\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dfb69c2-a468-4992-b474-657e1f154757-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.245243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.245232 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.345995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-config-volume\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dfb69c2-a468-4992-b474-657e1f154757-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346082 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dfb69c2-a468-4992-b474-657e1f154757-config-out\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0dfb69c2-a468-4992-b474-657e1f154757-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dfb69c2-a468-4992-b474-657e1f154757-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346487 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btvzq\" (UniqueName: \"kubernetes.io/projected/0dfb69c2-a468-4992-b474-657e1f154757-kube-api-access-btvzq\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346487 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-web-config\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346487 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dfb69c2-a468-4992-b474-657e1f154757-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346487 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346487 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.346898 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.346874 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dfb69c2-a468-4992-b474-657e1f154757-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349143 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dfb69c2-a468-4992-b474-657e1f154757-config-out\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349236 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349236 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349360 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dfb69c2-a468-4992-b474-657e1f154757-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0dfb69c2-a468-4992-b474-657e1f154757-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349736 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349482 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-config-volume\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349736 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.349736 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.349680 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-web-config\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.350048 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.350026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dfb69c2-a468-4992-b474-657e1f154757-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.350117 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.350099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.351360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.351337 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0dfb69c2-a468-4992-b474-657e1f154757-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.358530 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.358514 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btvzq\" (UniqueName: \"kubernetes.io/projected/0dfb69c2-a468-4992-b474-657e1f154757-kube-api-access-btvzq\") pod \"alertmanager-main-0\" (UID: \"0dfb69c2-a468-4992-b474-657e1f154757\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.492543 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.492469 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:06:23.833977 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.833950 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:06:23.835374 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:06:23.835350 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfb69c2_a468_4992_b474_657e1f154757.slice/crio-c1000cfc6b5fc15966c8882e102eff3c889a90ea9ec996f698d4261605f5d129 WatchSource:0}: Error finding container c1000cfc6b5fc15966c8882e102eff3c889a90ea9ec996f698d4261605f5d129: Status 404 returned error can't find the container with id c1000cfc6b5fc15966c8882e102eff3c889a90ea9ec996f698d4261605f5d129 Jul 02 19:06:23.952228 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.952196 2582 generic.go:356] "Generic (PLEG): container finished" podID="0dfb69c2-a468-4992-b474-657e1f154757" containerID="2c5dbd8270aa1b78329ab93ac389a8c9c98cf8b3bbd806518fac8e6de1ba38f5" exitCode=0 Jul 02 19:06:23.952317 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.952279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerDied","Data":"2c5dbd8270aa1b78329ab93ac389a8c9c98cf8b3bbd806518fac8e6de1ba38f5"} Jul 02 19:06:23.952357 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:23.952346 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"c1000cfc6b5fc15966c8882e102eff3c889a90ea9ec996f698d4261605f5d129"} Jul 02 19:06:26.967512 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:26.967487 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"8d88eb4e1337bb2f29c528f495e01915839829f9a94677fb2793e4bc22e5a5fb"} Jul 02 19:06:26.967801 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:26.967573 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"f90dcad7dae3d69460cd29ba3547ed4f0fe53e872197092541347a2651c3b2c8"} Jul 02 19:06:27.973999 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:27.973963 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"67cad019f9aa2fc46294d06db5dc08b41718268b166ccd326739fa1a0af40786"} Jul 02 19:06:27.974428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:27.974025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"1a1e53a4dd2d97991e103dcae6fb243b24fa0c5ad252fda0239d975ddfcf8f4f"} Jul 02 19:06:27.974428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:27.974076 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"4d0893b5bc58cdbc5cddc28a2569449472c43c1640b04dcc4318a26d3522664f"} Jul 02 19:06:27.974428 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:27.974105 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dfb69c2-a468-4992-b474-657e1f154757","Type":"ContainerStarted","Data":"7db3eef4d8d3ac183d7efa31d57b5ca603acf47492a031e2d5a87cd8505afab8"} Jul 02 19:06:28.015059 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:28.015011 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.132445858 podStartE2EDuration="5.014993977s" totalImagesPullingTime="2.862637283s" totalInitContainerRuntime="19.910836ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:28.012905693 +0000 UTC m=+180.548663194" watchObservedRunningTime="2026-07-02 19:06:28.014993977 +0000 UTC m=+180.550751479" Jul 02 19:06:29.324753 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:29.324707 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:29.426714 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:29.426680 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:32.179932 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.179890 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797c4dd776-wvrfv"] Jul 02 19:06:32.183674 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.183644 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.196359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.196330 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797c4dd776-wvrfv"] Jul 02 19:06:32.247037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.246999 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:32.304485 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.304451 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:32.321579 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-serving-cert\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.321683 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-service-ca\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.321683 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-console-config\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.321798 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321706 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-oauth-serving-cert\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.321798 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-oauth-config\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.321798 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-trusted-ca-bundle\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.321916 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.321816 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rsdc\" (UniqueName: \"kubernetes.io/projected/895197f1-4209-440b-aef3-2d53dfd96cf3-kube-api-access-6rsdc\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.382471 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.382432 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:32.422612 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-oauth-config\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.422612 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-trusted-ca-bundle\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.422869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rsdc\" (UniqueName: \"kubernetes.io/projected/895197f1-4209-440b-aef3-2d53dfd96cf3-kube-api-access-6rsdc\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.422869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-serving-cert\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.422869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-service-ca\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.422869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422719 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-console-config\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.422869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.422810 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-oauth-serving-cert\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.423624 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.423595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-service-ca\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.423730 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.423636 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-trusted-ca-bundle\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.423730 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.423636 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-console-config\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.423730 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.423602 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-oauth-serving-cert\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.425229 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.425204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-serving-cert\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.425229 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.425221 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-oauth-config\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.430788 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.430722 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rsdc\" (UniqueName: \"kubernetes.io/projected/895197f1-4209-440b-aef3-2d53dfd96cf3-kube-api-access-6rsdc\") pod \"console-797c4dd776-wvrfv\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.443913 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.443893 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:32.497077 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.497042 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:32.631718 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.631692 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797c4dd776-wvrfv"] Jul 02 19:06:32.633580 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:06:32.633538 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895197f1_4209_440b_aef3_2d53dfd96cf3.slice/crio-56c18d04ac3969ea9236d8d355811e18025b7f1f7a7100702d02600a7ed19680 WatchSource:0}: Error finding container 56c18d04ac3969ea9236d8d355811e18025b7f1f7a7100702d02600a7ed19680: Status 404 returned error can't find the container with id 56c18d04ac3969ea9236d8d355811e18025b7f1f7a7100702d02600a7ed19680 Jul 02 19:06:32.991313 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.991212 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:32.995517 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.995479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797c4dd776-wvrfv" event={"ID":"895197f1-4209-440b-aef3-2d53dfd96cf3","Type":"ContainerStarted","Data":"51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309"} Jul 02 19:06:32.995625 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:32.995541 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797c4dd776-wvrfv" event={"ID":"895197f1-4209-440b-aef3-2d53dfd96cf3","Type":"ContainerStarted","Data":"56c18d04ac3969ea9236d8d355811e18025b7f1f7a7100702d02600a7ed19680"} Jul 02 19:06:33.020918 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:33.020866 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797c4dd776-wvrfv" podStartSLOduration=1.020849179 podStartE2EDuration="1.020849179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.018343787 +0000 UTC m=+185.554101289" watchObservedRunningTime="2026-07-02 19:06:33.020849179 +0000 UTC m=+185.556606679" Jul 02 19:06:33.093285 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:33.093240 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:39.718322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:39.718286 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:39.822002 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:39.821969 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:41.277070 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:41.277029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:42.497448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:42.497391 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:42.497448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:42.497468 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:42.502388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:42.502361 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:43.039743 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:43.039712 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:06:43.106295 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:43.106265 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8568595cdc-7xdhn"] Jul 02 19:06:43.254342 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:43.254302 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:43.354756 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:43.354660 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:43.418178 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:06:43.418139 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:04.946165 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:04.946125 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:05.583248 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:05.583212 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:08.132668 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.132619 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8568595cdc-7xdhn" podUID="2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" containerName="console" containerID="cri-o://b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210" gracePeriod=15 Jul 02 19:07:08.387829 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.387750 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:07:08.539072 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539025 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-trusted-ca-bundle\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539092 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-serving-cert\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539111 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-config\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539128 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-oauth-config\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539148 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-795tf\" (UniqueName: \"kubernetes.io/projected/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-kube-api-access-795tf\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539182 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-oauth-serving-cert\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539206 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-service-ca\") pod \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\" (UID: \"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464\") " Jul 02 19:07:08.539573 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539525 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-config" (OuterVolumeSpecName: "console-config") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:08.539673 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539633 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:08.539906 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539763 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:08.539906 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.539865 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-service-ca" (OuterVolumeSpecName: "service-ca") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:08.541432 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.541409 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:08.541551 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.541441 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-kube-api-access-795tf" (OuterVolumeSpecName: "kube-api-access-795tf") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "kube-api-access-795tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:07:08.541551 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.541518 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" (UID: "2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639746 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-trusted-ca-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639774 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639800 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639808 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-console-oauth-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639817 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-795tf\" (UniqueName: \"kubernetes.io/projected/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-kube-api-access-795tf\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639825 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-oauth-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:08.639865 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:08.639833 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:09.138745 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.138702 2582 generic.go:356] "Generic (PLEG): container finished" podID="2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" containerID="b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210" exitCode=0 Jul 02 19:07:09.139272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.138798 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8568595cdc-7xdhn" Jul 02 19:07:09.139272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.138800 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8568595cdc-7xdhn" event={"ID":"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464","Type":"ContainerDied","Data":"b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210"} Jul 02 19:07:09.139272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.138924 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8568595cdc-7xdhn" event={"ID":"2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464","Type":"ContainerDied","Data":"ffd56055a68323f978695da2383afbb0c0690e9b655dabcb54d0ffe67f666dd6"} Jul 02 19:07:09.139272 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.138954 2582 scope.go:117] "RemoveContainer" containerID="b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210" Jul 02 19:07:09.148339 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.148320 2582 scope.go:117] "RemoveContainer" containerID="b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210" Jul 02 19:07:09.148636 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:07:09.148616 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210\": container with ID starting with b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210 not found: ID does not exist" containerID="b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210" Jul 02 19:07:09.148705 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.148649 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210"} err="failed to get container status \"b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210\": rpc error: code = NotFound desc = could not find container \"b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210\": container with ID starting with b4f40cc12074878a9cc8ad7ad9075911f26febceb30808cfdafd82cfa4ed3210 not found: ID does not exist" Jul 02 19:07:09.161739 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.161702 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8568595cdc-7xdhn"] Jul 02 19:07:09.168970 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:09.168940 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8568595cdc-7xdhn"] Jul 02 19:07:10.071041 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:10.071009 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" path="/var/lib/kubelet/pods/2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464/volumes" Jul 02 19:07:11.227349 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:11.227305 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:12.997011 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:12.996975 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:13.086889 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:13.086858 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:33.219045 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.219006 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:33.406358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.406317 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:33.910920 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.910887 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878"] Jul 02 19:07:33.911258 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.911228 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" containerName="console" Jul 02 19:07:33.911258 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.911242 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" containerName="console" Jul 02 19:07:33.911350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.911308 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf4d5fe-5426-43b2-ac3f-d3dc6b4cd464" containerName="console" Jul 02 19:07:33.914378 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.914360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:33.917185 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.917163 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:07:33.917293 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.917264 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:07:33.917377 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.917330 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-94tfz\"" Jul 02 19:07:33.924354 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:33.924333 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878"] Jul 02 19:07:34.053908 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.053870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vb5\" (UniqueName: \"kubernetes.io/projected/4488969a-666c-4a60-8688-f4bf9016e12d-kube-api-access-g7vb5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.054078 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.053922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.054078 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.053956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.154686 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.154652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vb5\" (UniqueName: \"kubernetes.io/projected/4488969a-666c-4a60-8688-f4bf9016e12d-kube-api-access-g7vb5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.154890 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.154712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.154890 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.154751 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.155168 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.155146 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.155204 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.155168 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.163503 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.163440 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vb5\" (UniqueName: \"kubernetes.io/projected/4488969a-666c-4a60-8688-f4bf9016e12d-kube-api-access-g7vb5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.223052 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.223025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:34.349042 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:34.349001 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878"] Jul 02 19:07:34.352715 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:07:34.352681 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4488969a_666c_4a60_8688_f4bf9016e12d.slice/crio-1bf3664d711221c9e84ab17a04a72793a677ff511a281d3d59eed8e80a17d9ba WatchSource:0}: Error finding container 1bf3664d711221c9e84ab17a04a72793a677ff511a281d3d59eed8e80a17d9ba: Status 404 returned error can't find the container with id 1bf3664d711221c9e84ab17a04a72793a677ff511a281d3d59eed8e80a17d9ba Jul 02 19:07:35.242857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:35.242817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" event={"ID":"4488969a-666c-4a60-8688-f4bf9016e12d","Type":"ContainerStarted","Data":"1bf3664d711221c9e84ab17a04a72793a677ff511a281d3d59eed8e80a17d9ba"} Jul 02 19:07:43.278791 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:43.278743 2582 generic.go:356] "Generic (PLEG): container finished" podID="4488969a-666c-4a60-8688-f4bf9016e12d" containerID="6c83c4aef67d7c7dd77b235dbf5966179d83e5739107bef396dd6c009a44b2be" exitCode=0 Jul 02 19:07:43.279343 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:43.278841 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" event={"ID":"4488969a-666c-4a60-8688-f4bf9016e12d","Type":"ContainerDied","Data":"6c83c4aef67d7c7dd77b235dbf5966179d83e5739107bef396dd6c009a44b2be"} Jul 02 19:07:46.294044 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:46.294002 2582 generic.go:356] "Generic (PLEG): container finished" podID="4488969a-666c-4a60-8688-f4bf9016e12d" containerID="19cade4d5af2b12355b912c6ba7bac93bad546aaa4efff2d5e1b424d2fe070db" exitCode=0 Jul 02 19:07:46.294430 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:46.294092 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" event={"ID":"4488969a-666c-4a60-8688-f4bf9016e12d","Type":"ContainerDied","Data":"19cade4d5af2b12355b912c6ba7bac93bad546aaa4efff2d5e1b424d2fe070db"} Jul 02 19:07:56.343365 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:56.343325 2582 generic.go:356] "Generic (PLEG): container finished" podID="4488969a-666c-4a60-8688-f4bf9016e12d" containerID="9b269c9bacc4c9eaec04f10944fa0933f79dba2cfda0099ba43ff45048689999" exitCode=0 Jul 02 19:07:56.343733 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:56.343386 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" event={"ID":"4488969a-666c-4a60-8688-f4bf9016e12d","Type":"ContainerDied","Data":"9b269c9bacc4c9eaec04f10944fa0933f79dba2cfda0099ba43ff45048689999"} Jul 02 19:07:57.501076 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.501042 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:57.572289 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.572253 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-util\") pod \"4488969a-666c-4a60-8688-f4bf9016e12d\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " Jul 02 19:07:57.572474 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.572328 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-bundle\") pod \"4488969a-666c-4a60-8688-f4bf9016e12d\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " Jul 02 19:07:57.572474 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.572392 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7vb5\" (UniqueName: \"kubernetes.io/projected/4488969a-666c-4a60-8688-f4bf9016e12d-kube-api-access-g7vb5\") pod \"4488969a-666c-4a60-8688-f4bf9016e12d\" (UID: \"4488969a-666c-4a60-8688-f4bf9016e12d\") " Jul 02 19:07:57.572999 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.572974 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-bundle" (OuterVolumeSpecName: "bundle") pod "4488969a-666c-4a60-8688-f4bf9016e12d" (UID: "4488969a-666c-4a60-8688-f4bf9016e12d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:07:57.574553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.574524 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4488969a-666c-4a60-8688-f4bf9016e12d-kube-api-access-g7vb5" (OuterVolumeSpecName: "kube-api-access-g7vb5") pod "4488969a-666c-4a60-8688-f4bf9016e12d" (UID: "4488969a-666c-4a60-8688-f4bf9016e12d"). InnerVolumeSpecName "kube-api-access-g7vb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:07:57.576308 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.576282 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-util" (OuterVolumeSpecName: "util") pod "4488969a-666c-4a60-8688-f4bf9016e12d" (UID: "4488969a-666c-4a60-8688-f4bf9016e12d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:07:57.673655 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.673574 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7vb5\" (UniqueName: \"kubernetes.io/projected/4488969a-666c-4a60-8688-f4bf9016e12d-kube-api-access-g7vb5\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:57.673655 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.673605 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:57.673655 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:57.673615 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4488969a-666c-4a60-8688-f4bf9016e12d-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:07:58.353831 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:58.353738 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" Jul 02 19:07:58.353831 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:58.353794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xp878" event={"ID":"4488969a-666c-4a60-8688-f4bf9016e12d","Type":"ContainerDied","Data":"1bf3664d711221c9e84ab17a04a72793a677ff511a281d3d59eed8e80a17d9ba"} Jul 02 19:07:58.354050 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:07:58.353844 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bf3664d711221c9e84ab17a04a72793a677ff511a281d3d59eed8e80a17d9ba" Jul 02 19:08:00.311381 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:00.311348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:01.662403 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:01.662344 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:02.340024 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.339989 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8"] Jul 02 19:08:02.340299 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340288 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="util" Jul 02 19:08:02.340347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340301 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="util" Jul 02 19:08:02.340347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340309 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="pull" Jul 02 19:08:02.340347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340314 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="pull" Jul 02 19:08:02.340347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340336 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="extract" Jul 02 19:08:02.340347 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340341 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="extract" Jul 02 19:08:02.340495 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.340390 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4488969a-666c-4a60-8688-f4bf9016e12d" containerName="extract" Jul 02 19:08:02.342410 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.342394 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.347459 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.347430 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kzcks\"" Jul 02 19:08:02.347459 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.347454 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:08:02.347695 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.347430 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 19:08:02.365541 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.365519 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8"] Jul 02 19:08:02.417717 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.417689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2180b9f-3252-4f7d-942c-554527574eeb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9bpp8\" (UID: \"e2180b9f-3252-4f7d-942c-554527574eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.417871 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.417728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mss\" (UniqueName: \"kubernetes.io/projected/e2180b9f-3252-4f7d-942c-554527574eeb-kube-api-access-q9mss\") pod \"cert-manager-operator-controller-manager-55c444bf86-9bpp8\" (UID: \"e2180b9f-3252-4f7d-942c-554527574eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.518886 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.518851 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2180b9f-3252-4f7d-942c-554527574eeb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9bpp8\" (UID: \"e2180b9f-3252-4f7d-942c-554527574eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.519038 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.518896 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mss\" (UniqueName: \"kubernetes.io/projected/e2180b9f-3252-4f7d-942c-554527574eeb-kube-api-access-q9mss\") pod \"cert-manager-operator-controller-manager-55c444bf86-9bpp8\" (UID: \"e2180b9f-3252-4f7d-942c-554527574eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.519230 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.519204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2180b9f-3252-4f7d-942c-554527574eeb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9bpp8\" (UID: \"e2180b9f-3252-4f7d-942c-554527574eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.528126 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.528097 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mss\" (UniqueName: \"kubernetes.io/projected/e2180b9f-3252-4f7d-942c-554527574eeb-kube-api-access-q9mss\") pod \"cert-manager-operator-controller-manager-55c444bf86-9bpp8\" (UID: \"e2180b9f-3252-4f7d-942c-554527574eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.651024 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.650949 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" Jul 02 19:08:02.781552 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:02.781525 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8"] Jul 02 19:08:02.783508 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:08:02.783475 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2180b9f_3252_4f7d_942c_554527574eeb.slice/crio-3cd17c5e7469a3a90a470b146d9231ae79d03dc67827db9acac010a00261b33d WatchSource:0}: Error finding container 3cd17c5e7469a3a90a470b146d9231ae79d03dc67827db9acac010a00261b33d: Status 404 returned error can't find the container with id 3cd17c5e7469a3a90a470b146d9231ae79d03dc67827db9acac010a00261b33d Jul 02 19:08:03.376455 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:03.376411 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" event={"ID":"e2180b9f-3252-4f7d-942c-554527574eeb","Type":"ContainerStarted","Data":"3cd17c5e7469a3a90a470b146d9231ae79d03dc67827db9acac010a00261b33d"} Jul 02 19:08:03.935351 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:03.935286 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:04.036135 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:04.036099 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:05.387764 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:05.387726 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" event={"ID":"e2180b9f-3252-4f7d-942c-554527574eeb","Type":"ContainerStarted","Data":"4b345debb47aa20573aa7b68a297c30ddb047ae4554430957a8270e49ecc026a"} Jul 02 19:08:05.394482 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:05.394454 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:05.414122 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:05.414075 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9bpp8" podStartSLOduration=1.5561998080000001 podStartE2EDuration="3.414061054s" totalImagesPullingTime="1.857861246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:05.412423073 +0000 UTC m=+277.948180576" watchObservedRunningTime="2026-07-02 19:08:05.414061054 +0000 UTC m=+277.949818555" Jul 02 19:08:05.497319 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:05.497287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:05.887467 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:05.887436 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:06.005942 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:06.005908 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:06.333718 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:06.333685 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:06.464762 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:06.464729 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:07.152937 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.152905 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz"] Jul 02 19:08:07.156514 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.156487 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.172863 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.172839 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:08:07.172863 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.172854 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:08:07.172997 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.172940 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-94tfz\"" Jul 02 19:08:07.179338 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.179316 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz"] Jul 02 19:08:07.263736 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.263704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.263939 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.263763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.263939 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.263833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t659g\" (UniqueName: \"kubernetes.io/projected/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-kube-api-access-t659g\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.364600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.364557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.364818 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.364616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.364818 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.364654 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t659g\" (UniqueName: \"kubernetes.io/projected/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-kube-api-access-t659g\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.365040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.365016 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.365099 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.365025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.380519 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.380486 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t659g\" (UniqueName: \"kubernetes.io/projected/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-kube-api-access-t659g\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.467884 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.467804 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:07.612432 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.612408 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz"] Jul 02 19:08:07.613901 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:08:07.613873 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553ff5bd_597a_4ecb_a820_3eef8ce2a3e5.slice/crio-d23a64b42dbe41ac9fc25cb30bf7f4bf35915e6921071e2409295cc675a3fd08 WatchSource:0}: Error finding container d23a64b42dbe41ac9fc25cb30bf7f4bf35915e6921071e2409295cc675a3fd08: Status 404 returned error can't find the container with id d23a64b42dbe41ac9fc25cb30bf7f4bf35915e6921071e2409295cc675a3fd08 Jul 02 19:08:07.665491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:07.665465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:08.111663 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:08.111616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:08.402439 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:08.402403 2582 generic.go:356] "Generic (PLEG): container finished" podID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerID="ad3b4bd1e82cdf95d38b83175e23710d586bdcb03b01da4b52f820f745f1d0c9" exitCode=0 Jul 02 19:08:08.402594 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:08.402449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" event={"ID":"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5","Type":"ContainerDied","Data":"ad3b4bd1e82cdf95d38b83175e23710d586bdcb03b01da4b52f820f745f1d0c9"} Jul 02 19:08:08.402594 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:08.402497 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" event={"ID":"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5","Type":"ContainerStarted","Data":"d23a64b42dbe41ac9fc25cb30bf7f4bf35915e6921071e2409295cc675a3fd08"} Jul 02 19:08:10.744376 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:10.744337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:10.858913 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:10.858869 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:11.998845 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:11.998808 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-47kkz"] Jul 02 19:08:12.001111 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.001096 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.008971 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.008950 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 19:08:12.010038 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.010017 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 19:08:12.010170 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.010153 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b2zs6\"" Jul 02 19:08:12.020849 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.020825 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-47kkz"] Jul 02 19:08:12.107025 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.106983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057fe854-3d37-42af-b2f1-3cd2691bfe09-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-47kkz\" (UID: \"057fe854-3d37-42af-b2f1-3cd2691bfe09\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.107207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.107077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdpp\" (UniqueName: \"kubernetes.io/projected/057fe854-3d37-42af-b2f1-3cd2691bfe09-kube-api-access-7kdpp\") pod \"cert-manager-cainjector-559cdd8c87-47kkz\" (UID: \"057fe854-3d37-42af-b2f1-3cd2691bfe09\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.208441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.208400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdpp\" (UniqueName: \"kubernetes.io/projected/057fe854-3d37-42af-b2f1-3cd2691bfe09-kube-api-access-7kdpp\") pod \"cert-manager-cainjector-559cdd8c87-47kkz\" (UID: \"057fe854-3d37-42af-b2f1-3cd2691bfe09\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.208612 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.208569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057fe854-3d37-42af-b2f1-3cd2691bfe09-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-47kkz\" (UID: \"057fe854-3d37-42af-b2f1-3cd2691bfe09\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.230246 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.230203 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057fe854-3d37-42af-b2f1-3cd2691bfe09-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-47kkz\" (UID: \"057fe854-3d37-42af-b2f1-3cd2691bfe09\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.230392 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.230318 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdpp\" (UniqueName: \"kubernetes.io/projected/057fe854-3d37-42af-b2f1-3cd2691bfe09-kube-api-access-7kdpp\") pod \"cert-manager-cainjector-559cdd8c87-47kkz\" (UID: \"057fe854-3d37-42af-b2f1-3cd2691bfe09\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.325633 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.325603 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" Jul 02 19:08:12.463599 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:12.463455 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-47kkz"] Jul 02 19:08:12.465892 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:08:12.465869 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod057fe854_3d37_42af_b2f1_3cd2691bfe09.slice/crio-8cc3408f623dec98948de7c43f350fccf88c06ff509472d0461e1678be1271de WatchSource:0}: Error finding container 8cc3408f623dec98948de7c43f350fccf88c06ff509472d0461e1678be1271de: Status 404 returned error can't find the container with id 8cc3408f623dec98948de7c43f350fccf88c06ff509472d0461e1678be1271de Jul 02 19:08:13.427357 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:13.427316 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" event={"ID":"057fe854-3d37-42af-b2f1-3cd2691bfe09","Type":"ContainerStarted","Data":"8cc3408f623dec98948de7c43f350fccf88c06ff509472d0461e1678be1271de"} Jul 02 19:08:15.437794 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:15.437743 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" event={"ID":"057fe854-3d37-42af-b2f1-3cd2691bfe09","Type":"ContainerStarted","Data":"5ce48a4c3487a3d5169f437ace7beb2704f7c63356395b1bb8a33566d2dbb7b4"} Jul 02 19:08:15.453607 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:15.453552 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-47kkz" podStartSLOduration=2.037638817 podStartE2EDuration="4.453535771s" totalImagesPullingTime="2.415896954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:15.452401299 +0000 UTC m=+287.988158801" watchObservedRunningTime="2026-07-02 19:08:15.453535771 +0000 UTC m=+287.989293271" Jul 02 19:08:15.661598 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:15.661569 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:15.761927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:15.761839 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:15.982264 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:15.982222 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:27.931832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:27.931798 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:08:27.932232 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:27.931919 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:08:27.935706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:27.935683 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:08:27.935911 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:27.935893 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:08:27.941346 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:27.941324 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 19:08:34.522658 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:34.522619 2582 generic.go:356] "Generic (PLEG): container finished" podID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerID="e9b48b6a00753435814d122943c4d5ad94412b6365cb2c1fc604367b7cd2326e" exitCode=0 Jul 02 19:08:34.523107 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:34.522675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" event={"ID":"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5","Type":"ContainerDied","Data":"e9b48b6a00753435814d122943c4d5ad94412b6365cb2c1fc604367b7cd2326e"} Jul 02 19:08:35.528835 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:35.528806 2582 generic.go:356] "Generic (PLEG): container finished" podID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerID="3324c0a3d3c048d394db068bd1b7c9e263f4c64e89aa136a2c6bd74c90d7a2b6" exitCode=0 Jul 02 19:08:35.529203 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:35.528937 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" event={"ID":"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5","Type":"ContainerDied","Data":"3324c0a3d3c048d394db068bd1b7c9e263f4c64e89aa136a2c6bd74c90d7a2b6"} Jul 02 19:08:36.661793 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.661759 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:36.700008 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.699984 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-bundle\") pod \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " Jul 02 19:08:36.700116 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.700069 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t659g\" (UniqueName: \"kubernetes.io/projected/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-kube-api-access-t659g\") pod \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " Jul 02 19:08:36.700116 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.700090 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-util\") pod \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\" (UID: \"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5\") " Jul 02 19:08:36.700327 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.700301 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-bundle" (OuterVolumeSpecName: "bundle") pod "553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" (UID: "553ff5bd-597a-4ecb-a820-3eef8ce2a3e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:08:36.702077 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.702054 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-kube-api-access-t659g" (OuterVolumeSpecName: "kube-api-access-t659g") pod "553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" (UID: "553ff5bd-597a-4ecb-a820-3eef8ce2a3e5"). InnerVolumeSpecName "kube-api-access-t659g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:08:36.706682 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.706657 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-util" (OuterVolumeSpecName: "util") pod "553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" (UID: "553ff5bd-597a-4ecb-a820-3eef8ce2a3e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:08:36.801573 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.801553 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:08:36.801654 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.801574 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t659g\" (UniqueName: \"kubernetes.io/projected/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-kube-api-access-t659g\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:08:36.801654 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:36.801584 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553ff5bd-597a-4ecb-a820-3eef8ce2a3e5-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:08:37.539191 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:37.539152 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" event={"ID":"553ff5bd-597a-4ecb-a820-3eef8ce2a3e5","Type":"ContainerDied","Data":"d23a64b42dbe41ac9fc25cb30bf7f4bf35915e6921071e2409295cc675a3fd08"} Jul 02 19:08:37.539191 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:37.539194 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxdrwz" Jul 02 19:08:37.539386 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:37.539206 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d23a64b42dbe41ac9fc25cb30bf7f4bf35915e6921071e2409295cc675a3fd08" Jul 02 19:08:41.655061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:41.655022 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:42.737518 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:42.737474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:47.463790 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:47.463742 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:47.564970 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:47.564936 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:49.234317 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234277 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg"] Jul 02 19:08:49.234701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234635 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="pull" Jul 02 19:08:49.234701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234646 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="pull" Jul 02 19:08:49.234701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234667 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="extract" Jul 02 19:08:49.234701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234673 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="extract" Jul 02 19:08:49.234701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234683 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="util" Jul 02 19:08:49.234701 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234687 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="util" Jul 02 19:08:49.234968 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.234752 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="553ff5bd-597a-4ecb-a820-3eef8ce2a3e5" containerName="extract" Jul 02 19:08:49.237137 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.237118 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.239719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.239695 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:08:49.239837 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.239763 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:08:49.240679 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.240663 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-94tfz\"" Jul 02 19:08:49.245806 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.245765 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg"] Jul 02 19:08:49.311712 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.311674 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd7df\" (UniqueName: \"kubernetes.io/projected/ac8a480a-d104-460a-a227-5759b1355963-kube-api-access-sd7df\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.311907 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.311827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.311975 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.311914 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.357118 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.357078 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:49.412864 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.412830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd7df\" (UniqueName: \"kubernetes.io/projected/ac8a480a-d104-460a-a227-5759b1355963-kube-api-access-sd7df\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.413042 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.412883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.413042 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.412927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.413309 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.413292 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.413348 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.413311 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.421713 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.421688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd7df\" (UniqueName: \"kubernetes.io/projected/ac8a480a-d104-460a-a227-5759b1355963-kube-api-access-sd7df\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.546912 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.546882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:49.679204 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:49.679175 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg"] Jul 02 19:08:49.682524 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:08:49.682493 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8a480a_d104_460a_a227_5759b1355963.slice/crio-6f494a4868adb017838a66088f4a13a95163f69dba9b86c3e776f60066e4178d WatchSource:0}: Error finding container 6f494a4868adb017838a66088f4a13a95163f69dba9b86c3e776f60066e4178d: Status 404 returned error can't find the container with id 6f494a4868adb017838a66088f4a13a95163f69dba9b86c3e776f60066e4178d Jul 02 19:08:50.600639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:50.600603 2582 generic.go:356] "Generic (PLEG): container finished" podID="ac8a480a-d104-460a-a227-5759b1355963" containerID="6389678862b6ac3637dcdf834dd6a4020113d8a6cfc60176aefb94c174bc425c" exitCode=0 Jul 02 19:08:50.601207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:50.600639 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" event={"ID":"ac8a480a-d104-460a-a227-5759b1355963","Type":"ContainerDied","Data":"6389678862b6ac3637dcdf834dd6a4020113d8a6cfc60176aefb94c174bc425c"} Jul 02 19:08:50.601207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:50.600687 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" event={"ID":"ac8a480a-d104-460a-a227-5759b1355963","Type":"ContainerStarted","Data":"6f494a4868adb017838a66088f4a13a95163f69dba9b86c3e776f60066e4178d"} Jul 02 19:08:50.601355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:50.601336 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:08:51.607559 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:51.607522 2582 generic.go:356] "Generic (PLEG): container finished" podID="ac8a480a-d104-460a-a227-5759b1355963" containerID="bcbc452727e0af14e01afb4e3b864198cfad48ea2517ac1953d94d5412643a40" exitCode=0 Jul 02 19:08:51.607953 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:51.607575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" event={"ID":"ac8a480a-d104-460a-a227-5759b1355963","Type":"ContainerDied","Data":"bcbc452727e0af14e01afb4e3b864198cfad48ea2517ac1953d94d5412643a40"} Jul 02 19:08:52.613642 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:52.613610 2582 generic.go:356] "Generic (PLEG): container finished" podID="ac8a480a-d104-460a-a227-5759b1355963" containerID="db10907c99d79c0734059091d487d68ccf91bc33ba767b85735d697394786bda" exitCode=0 Jul 02 19:08:52.614036 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:52.613653 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" event={"ID":"ac8a480a-d104-460a-a227-5759b1355963","Type":"ContainerDied","Data":"db10907c99d79c0734059091d487d68ccf91bc33ba767b85735d697394786bda"} Jul 02 19:08:53.742678 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.742657 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:53.850421 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.850392 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-bundle\") pod \"ac8a480a-d104-460a-a227-5759b1355963\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " Jul 02 19:08:53.850553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.850427 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-util\") pod \"ac8a480a-d104-460a-a227-5759b1355963\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " Jul 02 19:08:53.850553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.850469 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd7df\" (UniqueName: \"kubernetes.io/projected/ac8a480a-d104-460a-a227-5759b1355963-kube-api-access-sd7df\") pod \"ac8a480a-d104-460a-a227-5759b1355963\" (UID: \"ac8a480a-d104-460a-a227-5759b1355963\") " Jul 02 19:08:53.851124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.851095 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-bundle" (OuterVolumeSpecName: "bundle") pod "ac8a480a-d104-460a-a227-5759b1355963" (UID: "ac8a480a-d104-460a-a227-5759b1355963"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:08:53.852580 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.852545 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8a480a-d104-460a-a227-5759b1355963-kube-api-access-sd7df" (OuterVolumeSpecName: "kube-api-access-sd7df") pod "ac8a480a-d104-460a-a227-5759b1355963" (UID: "ac8a480a-d104-460a-a227-5759b1355963"). InnerVolumeSpecName "kube-api-access-sd7df". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:08:53.856155 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.856130 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-util" (OuterVolumeSpecName: "util") pod "ac8a480a-d104-460a-a227-5759b1355963" (UID: "ac8a480a-d104-460a-a227-5759b1355963"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:08:53.951393 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.951315 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:08:53.951393 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.951342 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8a480a-d104-460a-a227-5759b1355963-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:08:53.951393 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:53.951356 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd7df\" (UniqueName: \"kubernetes.io/projected/ac8a480a-d104-460a-a227-5759b1355963-kube-api-access-sd7df\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:08:54.631029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:54.630992 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" event={"ID":"ac8a480a-d104-460a-a227-5759b1355963","Type":"ContainerDied","Data":"6f494a4868adb017838a66088f4a13a95163f69dba9b86c3e776f60066e4178d"} Jul 02 19:08:54.631029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:54.631017 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsk4rg" Jul 02 19:08:54.631243 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:54.631066 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f494a4868adb017838a66088f4a13a95163f69dba9b86c3e776f60066e4178d" Jul 02 19:08:57.502484 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.502444 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:57.562732 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.562699 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-744887b959-rs5lg"] Jul 02 19:08:57.563079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563064 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="util" Jul 02 19:08:57.563125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563080 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="util" Jul 02 19:08:57.563125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563101 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="extract" Jul 02 19:08:57.563125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563106 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="extract" Jul 02 19:08:57.563125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563116 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="pull" Jul 02 19:08:57.563125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563121 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="pull" Jul 02 19:08:57.563268 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.563170 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8a480a-d104-460a-a227-5759b1355963" containerName="extract" Jul 02 19:08:57.566323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.566304 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.569594 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.569576 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 19:08:57.569727 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.569710 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 19:08:57.570722 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.570703 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 19:08:57.570811 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.570729 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xnfzt\"" Jul 02 19:08:57.570811 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.570761 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:08:57.570915 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.570817 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 19:08:57.581378 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.581357 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-744887b959-rs5lg"] Jul 02 19:08:57.594972 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.594950 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:57.684375 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.684344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmmkf\" (UniqueName: \"kubernetes.io/projected/141dc3eb-8028-404f-9297-f5d2ac87799d-kube-api-access-bmmkf\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.684510 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.684377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/141dc3eb-8028-404f-9297-f5d2ac87799d-manager-config\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.684510 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.684395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/141dc3eb-8028-404f-9297-f5d2ac87799d-metrics-cert\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.684510 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.684486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/141dc3eb-8028-404f-9297-f5d2ac87799d-cert\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.785598 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.785532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/141dc3eb-8028-404f-9297-f5d2ac87799d-cert\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.785598 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.785586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmmkf\" (UniqueName: \"kubernetes.io/projected/141dc3eb-8028-404f-9297-f5d2ac87799d-kube-api-access-bmmkf\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.785758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.785606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/141dc3eb-8028-404f-9297-f5d2ac87799d-manager-config\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.785758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.785622 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/141dc3eb-8028-404f-9297-f5d2ac87799d-metrics-cert\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.786292 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.786269 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/141dc3eb-8028-404f-9297-f5d2ac87799d-manager-config\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.788088 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.788068 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/141dc3eb-8028-404f-9297-f5d2ac87799d-cert\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.788159 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.788085 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/141dc3eb-8028-404f-9297-f5d2ac87799d-metrics-cert\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.795094 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.795071 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmmkf\" (UniqueName: \"kubernetes.io/projected/141dc3eb-8028-404f-9297-f5d2ac87799d-kube-api-access-bmmkf\") pod \"lws-controller-manager-744887b959-rs5lg\" (UID: \"141dc3eb-8028-404f-9297-f5d2ac87799d\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:57.875902 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:57.875880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:08:58.014184 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:58.014145 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-744887b959-rs5lg"] Jul 02 19:08:58.016394 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:08:58.016368 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141dc3eb_8028_404f_9297_f5d2ac87799d.slice/crio-7753949ce5a561418bad63c103ad5ea6398260e9edbd5017fdab10d5ed7b618b WatchSource:0}: Error finding container 7753949ce5a561418bad63c103ad5ea6398260e9edbd5017fdab10d5ed7b618b: Status 404 returned error can't find the container with id 7753949ce5a561418bad63c103ad5ea6398260e9edbd5017fdab10d5ed7b618b Jul 02 19:08:58.651672 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:08:58.651633 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" event={"ID":"141dc3eb-8028-404f-9297-f5d2ac87799d","Type":"ContainerStarted","Data":"7753949ce5a561418bad63c103ad5ea6398260e9edbd5017fdab10d5ed7b618b"} Jul 02 19:09:00.664379 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:00.664334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" event={"ID":"141dc3eb-8028-404f-9297-f5d2ac87799d","Type":"ContainerStarted","Data":"01b4f7526fa53e10bea4c1e664a2aa0ab6b20f2f57480cf7d387f89f17a7bc2b"} Jul 02 19:09:00.664818 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:00.664428 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:09:00.682415 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:00.682361 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" podStartSLOduration=1.565372335 podStartE2EDuration="3.682341943s" totalImagesPullingTime="2.116969608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:00.681691157 +0000 UTC m=+333.217448676" watchObservedRunningTime="2026-07-02 19:09:00.682341943 +0000 UTC m=+333.218099444" Jul 02 19:09:04.819743 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:04.819707 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:04.919745 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:04.919702 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:05.389551 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.389515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:05.634260 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.634207 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:05.737468 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.737379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:05.787892 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.787860 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr"] Jul 02 19:09:05.792427 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.792408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:05.795680 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.795657 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 19:09:05.795802 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.795740 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 19:09:05.795903 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.795824 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tnjqd\"" Jul 02 19:09:05.796063 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.796050 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 19:09:05.796104 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.796092 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 19:09:05.808763 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.808742 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr"] Jul 02 19:09:05.964328 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.964296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/addc6b05-edd0-4c01-9818-3403b8d5adda-tmp\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:05.964656 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.964349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/addc6b05-edd0-4c01-9818-3403b8d5adda-manifests\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:05.964656 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.964375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59lmp\" (UniqueName: \"kubernetes.io/projected/addc6b05-edd0-4c01-9818-3403b8d5adda-kube-api-access-59lmp\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:05.964656 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.964423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/addc6b05-edd0-4c01-9818-3403b8d5adda-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:05.964656 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.964443 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/addc6b05-edd0-4c01-9818-3403b8d5adda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:05.975561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:05.975533 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:06.065641 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.065616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/addc6b05-edd0-4c01-9818-3403b8d5adda-tmp\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.065770 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.065664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/addc6b05-edd0-4c01-9818-3403b8d5adda-manifests\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.065770 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.065689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59lmp\" (UniqueName: \"kubernetes.io/projected/addc6b05-edd0-4c01-9818-3403b8d5adda-kube-api-access-59lmp\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.065888 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.065816 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/addc6b05-edd0-4c01-9818-3403b8d5adda-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.065888 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.065864 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/addc6b05-edd0-4c01-9818-3403b8d5adda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.066144 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.066121 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/addc6b05-edd0-4c01-9818-3403b8d5adda-manifests\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.068178 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.068153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/addc6b05-edd0-4c01-9818-3403b8d5adda-tmp\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.068296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.068226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/addc6b05-edd0-4c01-9818-3403b8d5adda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.068358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.068321 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/addc6b05-edd0-4c01-9818-3403b8d5adda-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.074457 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.074439 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59lmp\" (UniqueName: \"kubernetes.io/projected/addc6b05-edd0-4c01-9818-3403b8d5adda-kube-api-access-59lmp\") pod \"opendatahub-operator-controller-manager-cb89c69-q54wr\" (UID: \"addc6b05-edd0-4c01-9818-3403b8d5adda\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.075914 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.075885 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:06.102416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.102392 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:06.179419 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.179340 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:06.258098 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.258044 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr"] Jul 02 19:09:06.259849 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.259816 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:06.260694 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:09:06.260671 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddc6b05_edd0_4c01_9818_3403b8d5adda.slice/crio-fc32f1c6da55413d5d37b9df23c03cb0cb1f33c3dbe6d3824a72625603791a67 WatchSource:0}: Error finding container fc32f1c6da55413d5d37b9df23c03cb0cb1f33c3dbe6d3824a72625603791a67: Status 404 returned error can't find the container with id fc32f1c6da55413d5d37b9df23c03cb0cb1f33c3dbe6d3824a72625603791a67 Jul 02 19:09:06.335668 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.335562 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:06.694221 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:06.694137 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" event={"ID":"addc6b05-edd0-4c01-9818-3403b8d5adda","Type":"ContainerStarted","Data":"fc32f1c6da55413d5d37b9df23c03cb0cb1f33c3dbe6d3824a72625603791a67"} Jul 02 19:09:09.711845 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:09.711806 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" event={"ID":"addc6b05-edd0-4c01-9818-3403b8d5adda","Type":"ContainerStarted","Data":"bfec783f9160e9cdd12650d63347e0ac41e0f7a823f621d9f97dc6a0412a621c"} Jul 02 19:09:10.718238 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:10.718203 2582 generic.go:356] "Generic (PLEG): container finished" podID="addc6b05-edd0-4c01-9818-3403b8d5adda" containerID="bfec783f9160e9cdd12650d63347e0ac41e0f7a823f621d9f97dc6a0412a621c" exitCode=0 Jul 02 19:09:10.718690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:10.718263 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" event={"ID":"addc6b05-edd0-4c01-9818-3403b8d5adda","Type":"ContainerDied","Data":"bfec783f9160e9cdd12650d63347e0ac41e0f7a823f621d9f97dc6a0412a621c"} Jul 02 19:09:11.670946 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:11.670911 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-744887b959-rs5lg" Jul 02 19:09:11.727422 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:11.727370 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" event={"ID":"addc6b05-edd0-4c01-9818-3403b8d5adda","Type":"ContainerStarted","Data":"f82ad066facac06c64d4bc3fb18eb812eb153905f702d44d67d1a85d7a4bb036"} Jul 02 19:09:11.727938 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:11.727553 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:11.757098 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:11.757056 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" podStartSLOduration=2.482137284 podStartE2EDuration="6.757041448s" totalImagesPullingTime="3.188378488s" totalInitContainerRuntime="1.086525676s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:11.755532072 +0000 UTC m=+344.291289573" watchObservedRunningTime="2026-07-02 19:09:11.757041448 +0000 UTC m=+344.292798947" Jul 02 19:09:22.736300 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:22.736225 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-q54wr" Jul 02 19:09:24.819538 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:24.819476 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:24.975927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:24.975889 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:25.756269 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:25.756233 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:25.863655 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:25.863616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:25.969326 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:25.969286 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:26.088545 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:26.088506 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:26.496349 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:26.496259 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:26.687281 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:26.687239 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:30.732088 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:30.732056 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:31.165339 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:31.165295 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:32.416662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:32.416629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:32.521212 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:32.521166 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:34.320946 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:34.320905 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:35.578864 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:35.578812 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:35.744801 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:35.744750 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:35.890202 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:35.890118 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:35.996559 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:35.996529 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m"] Jul 02 19:09:36.002899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.002875 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.003024 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.002955 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc"] Jul 02 19:09:36.006271 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.006251 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xv7h9\"" Jul 02 19:09:36.006567 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.006552 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 19:09:36.006942 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.006924 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.010462 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.010441 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 19:09:36.010553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.010516 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-c9jr5\"" Jul 02 19:09:36.019675 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.019637 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m"] Jul 02 19:09:36.032439 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.032418 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc"] Jul 02 19:09:36.043655 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.043632 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:36.124808 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.124274 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e201540-5523-42ce-a836-f006a099b3cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.124808 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.124337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8d7\" (UniqueName: \"kubernetes.io/projected/f11a1588-d9b6-4416-8f55-4755ea04f373-kube-api-access-4k8d7\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.124808 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.124403 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwm92\" (UniqueName: \"kubernetes.io/projected/9e201540-5523-42ce-a836-f006a099b3cf-kube-api-access-zwm92\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.124808 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.124442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11a1588-d9b6-4416-8f55-4755ea04f373-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.225827 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.225724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e201540-5523-42ce-a836-f006a099b3cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.226193 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:09:36.226097 2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 19:09:36.226580 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.226561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8d7\" (UniqueName: \"kubernetes.io/projected/f11a1588-d9b6-4416-8f55-4755ea04f373-kube-api-access-4k8d7\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.226987 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:09:36.226958 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e201540-5523-42ce-a836-f006a099b3cf-cert podName:9e201540-5523-42ce-a836-f006a099b3cf nodeName:}" failed. No retries permitted until 2026-07-02 19:09:36.726935835 +0000 UTC m=+369.262693321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9e201540-5523-42ce-a836-f006a099b3cf-cert") pod "kserve-controller-manager-d6f4b65b8-vfwdc" (UID: "9e201540-5523-42ce-a836-f006a099b3cf") : secret "kserve-webhook-server-cert" not found Jul 02 19:09:36.227183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.227169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwm92\" (UniqueName: \"kubernetes.io/projected/9e201540-5523-42ce-a836-f006a099b3cf-kube-api-access-zwm92\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.227493 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.227477 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11a1588-d9b6-4416-8f55-4755ea04f373-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.227714 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:09:36.227641 2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 02 19:09:36.227879 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:09:36.227869 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11a1588-d9b6-4416-8f55-4755ea04f373-cert podName:f11a1588-d9b6-4416-8f55-4755ea04f373 nodeName:}" failed. No retries permitted until 2026-07-02 19:09:36.727853023 +0000 UTC m=+369.263610504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f11a1588-d9b6-4416-8f55-4755ea04f373-cert") pod "llmisvc-controller-manager-777c6bd7d5-4w99m" (UID: "f11a1588-d9b6-4416-8f55-4755ea04f373") : secret "llmisvc-webhook-server-cert" not found Jul 02 19:09:36.237633 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.237607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8d7\" (UniqueName: \"kubernetes.io/projected/f11a1588-d9b6-4416-8f55-4755ea04f373-kube-api-access-4k8d7\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.241046 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.241025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwm92\" (UniqueName: \"kubernetes.io/projected/9e201540-5523-42ce-a836-f006a099b3cf-kube-api-access-zwm92\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.430119 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.430076 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:36.731509 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.731476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11a1588-d9b6-4416-8f55-4755ea04f373-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.731930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.731539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e201540-5523-42ce-a836-f006a099b3cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.734074 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.734049 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e201540-5523-42ce-a836-f006a099b3cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfwdc\" (UID: \"9e201540-5523-42ce-a836-f006a099b3cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:36.734179 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.734072 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11a1588-d9b6-4416-8f55-4755ea04f373-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4w99m\" (UID: \"f11a1588-d9b6-4416-8f55-4755ea04f373\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.754986 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.754953 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:36.885498 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.885464 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:36.915131 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.915101 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:36.922509 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:36.922489 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:37.075509 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:09:37.075461 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf11a1588_d9b6_4416_8f55_4755ea04f373.slice/crio-5007baf005b20dcfe702476907d3ddeec5289d56f484ed5530ecab8953e725f3 WatchSource:0}: Error finding container 5007baf005b20dcfe702476907d3ddeec5289d56f484ed5530ecab8953e725f3: Status 404 returned error can't find the container with id 5007baf005b20dcfe702476907d3ddeec5289d56f484ed5530ecab8953e725f3 Jul 02 19:09:37.077083 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.077056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m"] Jul 02 19:09:37.095762 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.095738 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc"] Jul 02 19:09:37.098014 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:09:37.097983 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e201540_5523_42ce_a836_f006a099b3cf.slice/crio-ace1ef5238e44e7c26ffe5ea1a4db52b2db5919241521ca9bd01f5e1039b3840 WatchSource:0}: Error finding container ace1ef5238e44e7c26ffe5ea1a4db52b2db5919241521ca9bd01f5e1039b3840: Status 404 returned error can't find the container with id ace1ef5238e44e7c26ffe5ea1a4db52b2db5919241521ca9bd01f5e1039b3840 Jul 02 19:09:37.279283 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.279202 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:37.388678 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.388640 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:37.581856 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.581822 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:37.868241 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.868152 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" event={"ID":"f11a1588-d9b6-4416-8f55-4755ea04f373","Type":"ContainerStarted","Data":"5007baf005b20dcfe702476907d3ddeec5289d56f484ed5530ecab8953e725f3"} Jul 02 19:09:37.869335 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:37.869312 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" event={"ID":"9e201540-5523-42ce-a836-f006a099b3cf","Type":"ContainerStarted","Data":"ace1ef5238e44e7c26ffe5ea1a4db52b2db5919241521ca9bd01f5e1039b3840"} Jul 02 19:09:38.252757 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:38.252671 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:38.536429 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:38.536356 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:38.680700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:38.680664 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:39.881464 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:39.881425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" event={"ID":"9e201540-5523-42ce-a836-f006a099b3cf","Type":"ContainerStarted","Data":"297110215c7342e4efbfa36c6be591fdbbd803e36b9ad552e7f9b83a5a09e4ca"} Jul 02 19:09:39.881857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:39.881552 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:09:39.938225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:39.938172 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" podStartSLOduration=2.260054287 podStartE2EDuration="4.938158596s" totalImagesPullingTime="2.678104309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:39.937943486 +0000 UTC m=+372.473700988" watchObservedRunningTime="2026-07-02 19:09:39.938158596 +0000 UTC m=+372.473916096" Jul 02 19:09:41.891438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:41.891400 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" event={"ID":"f11a1588-d9b6-4416-8f55-4755ea04f373","Type":"ContainerStarted","Data":"187ac4378724578f677bc546bbe171c8a5746608531fa3c92de2ea257c5372f3"} Jul 02 19:09:41.891840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:41.891486 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:09:41.911119 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:09:41.911068 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" podStartSLOduration=3.115726053 podStartE2EDuration="6.911054243s" totalImagesPullingTime="3.79532819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:41.909586826 +0000 UTC m=+374.445344352" watchObservedRunningTime="2026-07-02 19:09:41.911054243 +0000 UTC m=+374.446811743" Jul 02 19:10:10.890973 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:10.890935 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfwdc" Jul 02 19:10:12.898473 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:12.898440 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4w99m" Jul 02 19:10:20.656436 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.656399 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797f9bff7f-dw9zs"] Jul 02 19:10:20.661300 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.661278 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f202e23a-725f-4078-8d61-e7f1581dc859-console-serving-cert\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664608 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-console-config\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664608 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f202e23a-725f-4078-8d61-e7f1581dc859-console-oauth-config\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7f26\" (UniqueName: \"kubernetes.io/projected/f202e23a-725f-4078-8d61-e7f1581dc859-kube-api-access-w7f26\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664719 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664684 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-trusted-ca-bundle\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-service-ca\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.664840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.664745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-oauth-serving-cert\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.694295 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.694252 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797f9bff7f-dw9zs"] Jul 02 19:10:20.765940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.765901 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f202e23a-725f-4078-8d61-e7f1581dc859-console-oauth-config\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.765997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7f26\" (UniqueName: \"kubernetes.io/projected/f202e23a-725f-4078-8d61-e7f1581dc859-kube-api-access-w7f26\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-trusted-ca-bundle\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-service-ca\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-oauth-serving-cert\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f202e23a-725f-4078-8d61-e7f1581dc859-console-serving-cert\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-console-config\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.766916 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766889 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-service-ca\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.767033 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766990 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-oauth-serving-cert\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.767033 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.766998 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-console-config\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.767244 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.767221 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f202e23a-725f-4078-8d61-e7f1581dc859-trusted-ca-bundle\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.768678 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.768648 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f202e23a-725f-4078-8d61-e7f1581dc859-console-oauth-config\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.768817 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.768733 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f202e23a-725f-4078-8d61-e7f1581dc859-console-serving-cert\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.783234 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.783206 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7f26\" (UniqueName: \"kubernetes.io/projected/f202e23a-725f-4078-8d61-e7f1581dc859-kube-api-access-w7f26\") pod \"console-797f9bff7f-dw9zs\" (UID: \"f202e23a-725f-4078-8d61-e7f1581dc859\") " pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:20.806983 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.806941 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:20.924258 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.924164 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:20.972073 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:20.972035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:21.110165 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:21.110138 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797f9bff7f-dw9zs"] Jul 02 19:10:21.111655 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:21.111631 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf202e23a_725f_4078_8d61_e7f1581dc859.slice/crio-9096670d5af1f426b69a95764b71b6bb40c8bbbae7df9c3724e40c7655552c27 WatchSource:0}: Error finding container 9096670d5af1f426b69a95764b71b6bb40c8bbbae7df9c3724e40c7655552c27: Status 404 returned error can't find the container with id 9096670d5af1f426b69a95764b71b6bb40c8bbbae7df9c3724e40c7655552c27 Jul 02 19:10:22.087079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:22.087043 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797f9bff7f-dw9zs" event={"ID":"f202e23a-725f-4078-8d61-e7f1581dc859","Type":"ContainerStarted","Data":"b1424b6a28ec389632958d170a768f0340ddf33627ca843542989d48e088b27d"} Jul 02 19:10:22.087486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:22.087108 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797f9bff7f-dw9zs" event={"ID":"f202e23a-725f-4078-8d61-e7f1581dc859","Type":"ContainerStarted","Data":"9096670d5af1f426b69a95764b71b6bb40c8bbbae7df9c3724e40c7655552c27"} Jul 02 19:10:22.129167 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:22.129108 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797f9bff7f-dw9zs" podStartSLOduration=2.129088664 podStartE2EDuration="2.129088664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:22.127675882 +0000 UTC m=+414.663433405" watchObservedRunningTime="2026-07-02 19:10:22.129088664 +0000 UTC m=+414.664846161" Jul 02 19:10:26.316771 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.316731 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:26.492823 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.492774 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xj6cf"] Jul 02 19:10:26.495710 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.495678 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:26.499881 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.499856 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j72bk\"" Jul 02 19:10:26.500744 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.500717 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 19:10:26.500744 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.500717 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 19:10:26.506735 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.506703 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:26.510129 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.510102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fdk5\" (UniqueName: \"kubernetes.io/projected/0b98fc31-2add-4bea-8a75-e96e242a3fb2-kube-api-access-2fdk5\") pod \"kuadrant-operator-catalog-xj6cf\" (UID: \"0b98fc31-2add-4bea-8a75-e96e242a3fb2\") " pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:26.513706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.513682 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xj6cf"] Jul 02 19:10:26.611218 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.611129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fdk5\" (UniqueName: \"kubernetes.io/projected/0b98fc31-2add-4bea-8a75-e96e242a3fb2-kube-api-access-2fdk5\") pod \"kuadrant-operator-catalog-xj6cf\" (UID: \"0b98fc31-2add-4bea-8a75-e96e242a3fb2\") " pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:26.629665 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.629637 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fdk5\" (UniqueName: \"kubernetes.io/projected/0b98fc31-2add-4bea-8a75-e96e242a3fb2-kube-api-access-2fdk5\") pod \"kuadrant-operator-catalog-xj6cf\" (UID: \"0b98fc31-2add-4bea-8a75-e96e242a3fb2\") " pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:26.654544 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.654517 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:26.807911 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.807872 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:26.976110 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:26.976088 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xj6cf"] Jul 02 19:10:26.978361 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:26.978331 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b98fc31_2add_4bea_8a75_e96e242a3fb2.slice/crio-f3131fb7abfe2b10f38bb179b41f3337acc4acf3768913d9d3c6de8a14eada51 WatchSource:0}: Error finding container f3131fb7abfe2b10f38bb179b41f3337acc4acf3768913d9d3c6de8a14eada51: Status 404 returned error can't find the container with id f3131fb7abfe2b10f38bb179b41f3337acc4acf3768913d9d3c6de8a14eada51 Jul 02 19:10:27.113035 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:27.112998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" event={"ID":"0b98fc31-2add-4bea-8a75-e96e242a3fb2","Type":"ContainerStarted","Data":"f3131fb7abfe2b10f38bb179b41f3337acc4acf3768913d9d3c6de8a14eada51"} Jul 02 19:10:30.133220 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:30.133185 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" event={"ID":"0b98fc31-2add-4bea-8a75-e96e242a3fb2","Type":"ContainerStarted","Data":"e67a2a20c432f797c355c7811fc15bdfc0c023d26eb5411cc1e5402c68d7ef86"} Jul 02 19:10:30.200460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:30.200403 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" podStartSLOduration=1.756460896 podStartE2EDuration="4.200388678s" totalImagesPullingTime="2.443927782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:30.200250184 +0000 UTC m=+422.736007716" watchObservedRunningTime="2026-07-02 19:10:30.200388678 +0000 UTC m=+422.736146179" Jul 02 19:10:30.972686 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:30.972633 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:30.972868 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:30.972710 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:30.977471 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:30.977441 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:31.141797 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:31.141753 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797f9bff7f-dw9zs" Jul 02 19:10:31.200442 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:31.200397 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797c4dd776-wvrfv"] Jul 02 19:10:31.362051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:31.362013 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:31.462503 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:31.462465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:31.535601 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:31.535547 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:36.808804 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:36.808722 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:36.809437 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:36.808859 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:36.832056 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:36.832028 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:37.197643 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:37.197570 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xj6cf" Jul 02 19:10:40.923422 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:40.923385 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r"] Jul 02 19:10:40.927036 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:40.927017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:40.929957 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:40.929934 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfbmt\"" Jul 02 19:10:40.939899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:40.939873 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r"] Jul 02 19:10:41.041328 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.041290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clspj\" (UniqueName: \"kubernetes.io/projected/2d783fcb-dd19-4a91-9967-be33d8003460-kube-api-access-clspj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.041511 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.041353 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.041511 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.041437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.142634 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.142600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clspj\" (UniqueName: \"kubernetes.io/projected/2d783fcb-dd19-4a91-9967-be33d8003460-kube-api-access-clspj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.142818 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.142667 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.142818 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.142710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.143062 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.143042 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.143121 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.143104 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.151705 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.151674 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clspj\" (UniqueName: \"kubernetes.io/projected/2d783fcb-dd19-4a91-9967-be33d8003460-kube-api-access-clspj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.237057 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.236962 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:41.376363 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.376339 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r"] Jul 02 19:10:41.378038 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:41.378011 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d783fcb_dd19_4a91_9967_be33d8003460.slice/crio-836b40c277b43227b1f4dc7f17ca5f23375cd92bb64028c9bceac8bb7e60acc7 WatchSource:0}: Error finding container 836b40c277b43227b1f4dc7f17ca5f23375cd92bb64028c9bceac8bb7e60acc7: Status 404 returned error can't find the container with id 836b40c277b43227b1f4dc7f17ca5f23375cd92bb64028c9bceac8bb7e60acc7 Jul 02 19:10:41.714702 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.714660 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6"] Jul 02 19:10:41.717445 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.717423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.727174 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.727151 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6"] Jul 02 19:10:41.748211 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.748182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.748364 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.748235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.748364 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.748315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkdb\" (UniqueName: \"kubernetes.io/projected/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-kube-api-access-hkkdb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.849182 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.849143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.849363 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.849202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkdb\" (UniqueName: \"kubernetes.io/projected/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-kube-api-access-hkkdb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.849363 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.849261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.849596 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.849576 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.849659 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.849643 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:41.857826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:41.857769 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkdb\" (UniqueName: \"kubernetes.io/projected/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-kube-api-access-hkkdb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:42.027432 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.027356 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:42.185634 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.185603 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6"] Jul 02 19:10:42.190682 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:42.190654 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b17188d_ac54_443b_adf1_3e3a6dcf75cb.slice/crio-4bb80fd23380ff3b95cbb76cdbd93b64fb1d73eda6b3118ba49b378be8193b80 WatchSource:0}: Error finding container 4bb80fd23380ff3b95cbb76cdbd93b64fb1d73eda6b3118ba49b378be8193b80: Status 404 returned error can't find the container with id 4bb80fd23380ff3b95cbb76cdbd93b64fb1d73eda6b3118ba49b378be8193b80 Jul 02 19:10:42.202143 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.202114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" event={"ID":"3b17188d-ac54-443b-adf1-3e3a6dcf75cb","Type":"ContainerStarted","Data":"4bb80fd23380ff3b95cbb76cdbd93b64fb1d73eda6b3118ba49b378be8193b80"} Jul 02 19:10:42.203591 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.203571 2582 generic.go:356] "Generic (PLEG): container finished" podID="2d783fcb-dd19-4a91-9967-be33d8003460" containerID="5f1284cc1e5b9523cca241e88b2aebeb10edd85a0bc25eb67ae993bf01094744" exitCode=0 Jul 02 19:10:42.203688 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.203652 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" event={"ID":"2d783fcb-dd19-4a91-9967-be33d8003460","Type":"ContainerDied","Data":"5f1284cc1e5b9523cca241e88b2aebeb10edd85a0bc25eb67ae993bf01094744"} Jul 02 19:10:42.203735 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.203686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" event={"ID":"2d783fcb-dd19-4a91-9967-be33d8003460","Type":"ContainerStarted","Data":"836b40c277b43227b1f4dc7f17ca5f23375cd92bb64028c9bceac8bb7e60acc7"} Jul 02 19:10:42.314669 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.314641 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p"] Jul 02 19:10:42.317455 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.317438 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.330136 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.330111 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p"] Jul 02 19:10:42.353179 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.353150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.353293 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.353192 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.353293 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.353238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spjcj\" (UniqueName: \"kubernetes.io/projected/4a518d23-2659-48d2-9e7b-5f81a537a99d-kube-api-access-spjcj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.454162 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.454128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spjcj\" (UniqueName: \"kubernetes.io/projected/4a518d23-2659-48d2-9e7b-5f81a537a99d-kube-api-access-spjcj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.454343 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.454206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.454343 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.454244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.454688 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.454664 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.454725 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.454676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.463864 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.463835 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spjcj\" (UniqueName: \"kubernetes.io/projected/4a518d23-2659-48d2-9e7b-5f81a537a99d-kube-api-access-spjcj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.660718 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.660636 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:42.740500 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.740470 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z"] Jul 02 19:10:42.743049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.743030 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.756171 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.756145 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z"] Jul 02 19:10:42.815302 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.815279 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p"] Jul 02 19:10:42.859367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.859328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.859546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.859375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8rvr\" (UniqueName: \"kubernetes.io/projected/068c12e5-606d-4f74-b2f9-165a3a223df7-kube-api-access-c8rvr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.859546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.859443 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.876661 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:42.876631 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a518d23_2659_48d2_9e7b_5f81a537a99d.slice/crio-7c6715d3a0b7c9fb71b3bd273c343ff515ea182d588f4b255d11f4231e2f2f32 WatchSource:0}: Error finding container 7c6715d3a0b7c9fb71b3bd273c343ff515ea182d588f4b255d11f4231e2f2f32: Status 404 returned error can't find the container with id 7c6715d3a0b7c9fb71b3bd273c343ff515ea182d588f4b255d11f4231e2f2f32 Jul 02 19:10:42.960680 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.960648 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.960832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.960684 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8rvr\" (UniqueName: \"kubernetes.io/projected/068c12e5-606d-4f74-b2f9-165a3a223df7-kube-api-access-c8rvr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.960832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.960714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.961089 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.961068 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.961161 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.961087 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:42.970553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:42.970526 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8rvr\" (UniqueName: \"kubernetes.io/projected/068c12e5-606d-4f74-b2f9-165a3a223df7-kube-api-access-c8rvr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:43.056114 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.056085 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:43.195628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.195604 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z"] Jul 02 19:10:43.197572 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:43.197544 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068c12e5_606d_4f74_b2f9_165a3a223df7.slice/crio-5fe0fc0c75a6503a6a1d5468744b8943467e449f449d20802982246b7cc771db WatchSource:0}: Error finding container 5fe0fc0c75a6503a6a1d5468744b8943467e449f449d20802982246b7cc771db: Status 404 returned error can't find the container with id 5fe0fc0c75a6503a6a1d5468744b8943467e449f449d20802982246b7cc771db Jul 02 19:10:43.209510 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.209483 2582 generic.go:356] "Generic (PLEG): container finished" podID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerID="6bfe09887f3e0c741d3d39af05eb5106ac8445feaa48db5791d5647cfdde133f" exitCode=0 Jul 02 19:10:43.209592 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.209567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" event={"ID":"3b17188d-ac54-443b-adf1-3e3a6dcf75cb","Type":"ContainerDied","Data":"6bfe09887f3e0c741d3d39af05eb5106ac8445feaa48db5791d5647cfdde133f"} Jul 02 19:10:43.211190 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.211165 2582 generic.go:356] "Generic (PLEG): container finished" podID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerID="e99167e8d20954307c9b3dd01942f7bd886d007e04d4645fffd477577762a7e8" exitCode=0 Jul 02 19:10:43.211275 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.211243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" event={"ID":"4a518d23-2659-48d2-9e7b-5f81a537a99d","Type":"ContainerDied","Data":"e99167e8d20954307c9b3dd01942f7bd886d007e04d4645fffd477577762a7e8"} Jul 02 19:10:43.211343 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.211290 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" event={"ID":"4a518d23-2659-48d2-9e7b-5f81a537a99d","Type":"ContainerStarted","Data":"7c6715d3a0b7c9fb71b3bd273c343ff515ea182d588f4b255d11f4231e2f2f32"} Jul 02 19:10:43.213331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.213311 2582 generic.go:356] "Generic (PLEG): container finished" podID="2d783fcb-dd19-4a91-9967-be33d8003460" containerID="9b986da97627871d0c180f0043b71e1c0854008f12e0b93eca4ec6911dc96a6a" exitCode=0 Jul 02 19:10:43.213437 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.213382 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" event={"ID":"2d783fcb-dd19-4a91-9967-be33d8003460","Type":"ContainerDied","Data":"9b986da97627871d0c180f0043b71e1c0854008f12e0b93eca4ec6911dc96a6a"} Jul 02 19:10:43.214673 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:43.214653 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" event={"ID":"068c12e5-606d-4f74-b2f9-165a3a223df7","Type":"ContainerStarted","Data":"5fe0fc0c75a6503a6a1d5468744b8943467e449f449d20802982246b7cc771db"} Jul 02 19:10:44.222236 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:44.222197 2582 generic.go:356] "Generic (PLEG): container finished" podID="2d783fcb-dd19-4a91-9967-be33d8003460" containerID="aa2e217511524ae283945d2c789acfd030016a442bfa778990e1460617f3e163" exitCode=0 Jul 02 19:10:44.222677 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:44.222248 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" event={"ID":"2d783fcb-dd19-4a91-9967-be33d8003460","Type":"ContainerDied","Data":"aa2e217511524ae283945d2c789acfd030016a442bfa778990e1460617f3e163"} Jul 02 19:10:44.223848 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:44.223825 2582 generic.go:356] "Generic (PLEG): container finished" podID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerID="790c8201186033e5837f446b5bf84455cb99389e7347de92a6a7c1c830fc3440" exitCode=0 Jul 02 19:10:44.223962 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:44.223888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" event={"ID":"068c12e5-606d-4f74-b2f9-165a3a223df7","Type":"ContainerDied","Data":"790c8201186033e5837f446b5bf84455cb99389e7347de92a6a7c1c830fc3440"} Jul 02 19:10:44.225775 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:44.225752 2582 generic.go:356] "Generic (PLEG): container finished" podID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerID="2cc2156cb902c3fa3e0ecce1d800f0f9196d6fa753a95c0629c899d51abf3fb6" exitCode=0 Jul 02 19:10:44.225862 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:44.225828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" event={"ID":"3b17188d-ac54-443b-adf1-3e3a6dcf75cb","Type":"ContainerDied","Data":"2cc2156cb902c3fa3e0ecce1d800f0f9196d6fa753a95c0629c899d51abf3fb6"} Jul 02 19:10:45.232526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.232439 2582 generic.go:356] "Generic (PLEG): container finished" podID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerID="1eebec13c2573e2945ba8e33b9376fec3da710ee7ef131a908574c4c32283835" exitCode=0 Jul 02 19:10:45.232952 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.232531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" event={"ID":"3b17188d-ac54-443b-adf1-3e3a6dcf75cb","Type":"ContainerDied","Data":"1eebec13c2573e2945ba8e33b9376fec3da710ee7ef131a908574c4c32283835"} Jul 02 19:10:45.234319 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.234297 2582 generic.go:356] "Generic (PLEG): container finished" podID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerID="e86b0f9a6ad5e461088b8c0459c4fbbb987ce7a52ec4c99a02190d64d181fe11" exitCode=0 Jul 02 19:10:45.234394 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.234372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" event={"ID":"4a518d23-2659-48d2-9e7b-5f81a537a99d","Type":"ContainerDied","Data":"e86b0f9a6ad5e461088b8c0459c4fbbb987ce7a52ec4c99a02190d64d181fe11"} Jul 02 19:10:45.236206 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.236172 2582 generic.go:356] "Generic (PLEG): container finished" podID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerID="44c574d364300410ccf4081f11f59ee2d69a160f7633805d5c4b523165704bac" exitCode=0 Jul 02 19:10:45.236316 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.236258 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" event={"ID":"068c12e5-606d-4f74-b2f9-165a3a223df7","Type":"ContainerDied","Data":"44c574d364300410ccf4081f11f59ee2d69a160f7633805d5c4b523165704bac"} Jul 02 19:10:45.390560 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.390525 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:45.483852 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.483757 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-bundle\") pod \"2d783fcb-dd19-4a91-9967-be33d8003460\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " Jul 02 19:10:45.483852 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.483820 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-util\") pod \"2d783fcb-dd19-4a91-9967-be33d8003460\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " Jul 02 19:10:45.484051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.483879 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clspj\" (UniqueName: \"kubernetes.io/projected/2d783fcb-dd19-4a91-9967-be33d8003460-kube-api-access-clspj\") pod \"2d783fcb-dd19-4a91-9967-be33d8003460\" (UID: \"2d783fcb-dd19-4a91-9967-be33d8003460\") " Jul 02 19:10:45.484326 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.484299 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-bundle" (OuterVolumeSpecName: "bundle") pod "2d783fcb-dd19-4a91-9967-be33d8003460" (UID: "2d783fcb-dd19-4a91-9967-be33d8003460"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:45.486022 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.485999 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d783fcb-dd19-4a91-9967-be33d8003460-kube-api-access-clspj" (OuterVolumeSpecName: "kube-api-access-clspj") pod "2d783fcb-dd19-4a91-9967-be33d8003460" (UID: "2d783fcb-dd19-4a91-9967-be33d8003460"). InnerVolumeSpecName "kube-api-access-clspj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:10:45.489350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.489329 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-util" (OuterVolumeSpecName: "util") pod "2d783fcb-dd19-4a91-9967-be33d8003460" (UID: "2d783fcb-dd19-4a91-9967-be33d8003460"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:45.585511 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.585485 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:45.585511 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.585506 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d783fcb-dd19-4a91-9967-be33d8003460-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:45.585661 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:45.585515 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clspj\" (UniqueName: \"kubernetes.io/projected/2d783fcb-dd19-4a91-9967-be33d8003460-kube-api-access-clspj\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:46.243415 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.243381 2582 generic.go:356] "Generic (PLEG): container finished" podID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerID="61aecd77111e867f6a3b6c5e9695885fa47088986fe9b5d2a20930ff9123deb3" exitCode=0 Jul 02 19:10:46.243854 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.243472 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" event={"ID":"4a518d23-2659-48d2-9e7b-5f81a537a99d","Type":"ContainerDied","Data":"61aecd77111e867f6a3b6c5e9695885fa47088986fe9b5d2a20930ff9123deb3"} Jul 02 19:10:46.245374 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.245349 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" event={"ID":"2d783fcb-dd19-4a91-9967-be33d8003460","Type":"ContainerDied","Data":"836b40c277b43227b1f4dc7f17ca5f23375cd92bb64028c9bceac8bb7e60acc7"} Jul 02 19:10:46.245374 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.245364 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r" Jul 02 19:10:46.245551 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.245383 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="836b40c277b43227b1f4dc7f17ca5f23375cd92bb64028c9bceac8bb7e60acc7" Jul 02 19:10:46.247714 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.247688 2582 generic.go:356] "Generic (PLEG): container finished" podID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerID="4753c7b852ff1101bb6ebdbc2d5654d53fe2831bfe8b491b9ab34d6bc5237470" exitCode=0 Jul 02 19:10:46.247874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.247769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" event={"ID":"068c12e5-606d-4f74-b2f9-165a3a223df7","Type":"ContainerDied","Data":"4753c7b852ff1101bb6ebdbc2d5654d53fe2831bfe8b491b9ab34d6bc5237470"} Jul 02 19:10:46.385927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.385901 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:46.493625 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.493597 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkkdb\" (UniqueName: \"kubernetes.io/projected/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-kube-api-access-hkkdb\") pod \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " Jul 02 19:10:46.493756 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.493634 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-util\") pod \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " Jul 02 19:10:46.493756 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.493652 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-bundle\") pod \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\" (UID: \"3b17188d-ac54-443b-adf1-3e3a6dcf75cb\") " Jul 02 19:10:46.494255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.494231 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-bundle" (OuterVolumeSpecName: "bundle") pod "3b17188d-ac54-443b-adf1-3e3a6dcf75cb" (UID: "3b17188d-ac54-443b-adf1-3e3a6dcf75cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:46.495667 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.495643 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-kube-api-access-hkkdb" (OuterVolumeSpecName: "kube-api-access-hkkdb") pod "3b17188d-ac54-443b-adf1-3e3a6dcf75cb" (UID: "3b17188d-ac54-443b-adf1-3e3a6dcf75cb"). InnerVolumeSpecName "kube-api-access-hkkdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:10:46.499148 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.499110 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-util" (OuterVolumeSpecName: "util") pod "3b17188d-ac54-443b-adf1-3e3a6dcf75cb" (UID: "3b17188d-ac54-443b-adf1-3e3a6dcf75cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:46.595143 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.595113 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkkdb\" (UniqueName: \"kubernetes.io/projected/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-kube-api-access-hkkdb\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:46.595143 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.595136 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:46.595143 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:46.595146 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b17188d-ac54-443b-adf1-3e3a6dcf75cb-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:47.261204 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.261176 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" Jul 02 19:10:47.261628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.261205 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6" event={"ID":"3b17188d-ac54-443b-adf1-3e3a6dcf75cb","Type":"ContainerDied","Data":"4bb80fd23380ff3b95cbb76cdbd93b64fb1d73eda6b3118ba49b378be8193b80"} Jul 02 19:10:47.261628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.261281 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bb80fd23380ff3b95cbb76cdbd93b64fb1d73eda6b3118ba49b378be8193b80" Jul 02 19:10:47.402177 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.402151 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:47.423910 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.423886 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:47.502904 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.502878 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-bundle\") pod \"4a518d23-2659-48d2-9e7b-5f81a537a99d\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " Jul 02 19:10:47.503029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.502938 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-util\") pod \"4a518d23-2659-48d2-9e7b-5f81a537a99d\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " Jul 02 19:10:47.503029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.502962 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spjcj\" (UniqueName: \"kubernetes.io/projected/4a518d23-2659-48d2-9e7b-5f81a537a99d-kube-api-access-spjcj\") pod \"4a518d23-2659-48d2-9e7b-5f81a537a99d\" (UID: \"4a518d23-2659-48d2-9e7b-5f81a537a99d\") " Jul 02 19:10:47.503029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.502978 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8rvr\" (UniqueName: \"kubernetes.io/projected/068c12e5-606d-4f74-b2f9-165a3a223df7-kube-api-access-c8rvr\") pod \"068c12e5-606d-4f74-b2f9-165a3a223df7\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " Jul 02 19:10:47.503164 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.503041 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-util\") pod \"068c12e5-606d-4f74-b2f9-165a3a223df7\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " Jul 02 19:10:47.503235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.503211 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-bundle\") pod \"068c12e5-606d-4f74-b2f9-165a3a223df7\" (UID: \"068c12e5-606d-4f74-b2f9-165a3a223df7\") " Jul 02 19:10:47.503500 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.503466 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-bundle" (OuterVolumeSpecName: "bundle") pod "4a518d23-2659-48d2-9e7b-5f81a537a99d" (UID: "4a518d23-2659-48d2-9e7b-5f81a537a99d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:47.503747 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.503700 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-bundle" (OuterVolumeSpecName: "bundle") pod "068c12e5-606d-4f74-b2f9-165a3a223df7" (UID: "068c12e5-606d-4f74-b2f9-165a3a223df7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:47.505163 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.505141 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068c12e5-606d-4f74-b2f9-165a3a223df7-kube-api-access-c8rvr" (OuterVolumeSpecName: "kube-api-access-c8rvr") pod "068c12e5-606d-4f74-b2f9-165a3a223df7" (UID: "068c12e5-606d-4f74-b2f9-165a3a223df7"). InnerVolumeSpecName "kube-api-access-c8rvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:10:47.505250 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.505227 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a518d23-2659-48d2-9e7b-5f81a537a99d-kube-api-access-spjcj" (OuterVolumeSpecName: "kube-api-access-spjcj") pod "4a518d23-2659-48d2-9e7b-5f81a537a99d" (UID: "4a518d23-2659-48d2-9e7b-5f81a537a99d"). InnerVolumeSpecName "kube-api-access-spjcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:10:47.511415 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.511354 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-util" (OuterVolumeSpecName: "util") pod "068c12e5-606d-4f74-b2f9-165a3a223df7" (UID: "068c12e5-606d-4f74-b2f9-165a3a223df7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:47.511886 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.511868 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-util" (OuterVolumeSpecName: "util") pod "4a518d23-2659-48d2-9e7b-5f81a537a99d" (UID: "4a518d23-2659-48d2-9e7b-5f81a537a99d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:10:47.604295 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.604270 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:47.604295 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.604292 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/068c12e5-606d-4f74-b2f9-165a3a223df7-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:47.604416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.604300 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:47.604416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.604308 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a518d23-2659-48d2-9e7b-5f81a537a99d-util\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:47.604416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.604316 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spjcj\" (UniqueName: \"kubernetes.io/projected/4a518d23-2659-48d2-9e7b-5f81a537a99d-kube-api-access-spjcj\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:47.604416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:47.604326 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8rvr\" (UniqueName: \"kubernetes.io/projected/068c12e5-606d-4f74-b2f9-165a3a223df7-kube-api-access-c8rvr\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:48.269166 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:48.269140 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" Jul 02 19:10:48.269166 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:48.269155 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p" event={"ID":"4a518d23-2659-48d2-9e7b-5f81a537a99d","Type":"ContainerDied","Data":"7c6715d3a0b7c9fb71b3bd273c343ff515ea182d588f4b255d11f4231e2f2f32"} Jul 02 19:10:48.269595 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:48.269204 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c6715d3a0b7c9fb71b3bd273c343ff515ea182d588f4b255d11f4231e2f2f32" Jul 02 19:10:48.271154 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:48.271131 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" event={"ID":"068c12e5-606d-4f74-b2f9-165a3a223df7","Type":"ContainerDied","Data":"5fe0fc0c75a6503a6a1d5468744b8943467e449f449d20802982246b7cc771db"} Jul 02 19:10:48.271339 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:48.271319 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fe0fc0c75a6503a6a1d5468744b8943467e449f449d20802982246b7cc771db" Jul 02 19:10:48.271339 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:48.271189 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z" Jul 02 19:10:55.035906 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:55.035814 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:56.227244 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.227190 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-797c4dd776-wvrfv" podUID="895197f1-4209-440b-aef3-2d53dfd96cf3" containerName="console" containerID="cri-o://51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309" gracePeriod=15 Jul 02 19:10:56.474940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.474910 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:10:56.574407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574377 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-service-ca\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574426 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-serving-cert\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574445 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-oauth-config\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574465 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-trusted-ca-bundle\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574524 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-oauth-serving-cert\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574731 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574571 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-console-config\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574731 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574605 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rsdc\" (UniqueName: \"kubernetes.io/projected/895197f1-4209-440b-aef3-2d53dfd96cf3-kube-api-access-6rsdc\") pod \"895197f1-4209-440b-aef3-2d53dfd96cf3\" (UID: \"895197f1-4209-440b-aef3-2d53dfd96cf3\") " Jul 02 19:10:56.574874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.574820 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-service-ca" (OuterVolumeSpecName: "service-ca") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:10:56.575074 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.575042 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:10:56.575207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.575065 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:10:56.575207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.575086 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:56.575207 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.575188 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-console-config" (OuterVolumeSpecName: "console-config") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:10:56.576536 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.576516 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:10:56.577040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.577014 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895197f1-4209-440b-aef3-2d53dfd96cf3-kube-api-access-6rsdc" (OuterVolumeSpecName: "kube-api-access-6rsdc") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "kube-api-access-6rsdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:10:56.577040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.577020 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "895197f1-4209-440b-aef3-2d53dfd96cf3" (UID: "895197f1-4209-440b-aef3-2d53dfd96cf3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:10:56.676237 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.676212 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-oauth-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:56.676237 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.676234 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-console-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:56.676359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.676244 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rsdc\" (UniqueName: \"kubernetes.io/projected/895197f1-4209-440b-aef3-2d53dfd96cf3-kube-api-access-6rsdc\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:56.676359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.676253 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-serving-cert\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:56.676359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.676264 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/895197f1-4209-440b-aef3-2d53dfd96cf3-console-oauth-config\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:56.676359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:56.676273 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/895197f1-4209-440b-aef3-2d53dfd96cf3-trusted-ca-bundle\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:10:57.325167 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.325128 2582 generic.go:356] "Generic (PLEG): container finished" podID="895197f1-4209-440b-aef3-2d53dfd96cf3" containerID="51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309" exitCode=0 Jul 02 19:10:57.325629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.325197 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797c4dd776-wvrfv" Jul 02 19:10:57.325629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.325228 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797c4dd776-wvrfv" event={"ID":"895197f1-4209-440b-aef3-2d53dfd96cf3","Type":"ContainerDied","Data":"51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309"} Jul 02 19:10:57.325629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.325281 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797c4dd776-wvrfv" event={"ID":"895197f1-4209-440b-aef3-2d53dfd96cf3","Type":"ContainerDied","Data":"56c18d04ac3969ea9236d8d355811e18025b7f1f7a7100702d02600a7ed19680"} Jul 02 19:10:57.325629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.325307 2582 scope.go:117] "RemoveContainer" containerID="51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309" Jul 02 19:10:57.335252 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.335236 2582 scope.go:117] "RemoveContainer" containerID="51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309" Jul 02 19:10:57.335553 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:10:57.335530 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309\": container with ID starting with 51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309 not found: ID does not exist" containerID="51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309" Jul 02 19:10:57.335628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.335563 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309"} err="failed to get container status \"51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309\": rpc error: code = NotFound desc = could not find container \"51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309\": container with ID starting with 51eee6348c7fdb29a7a238c753ff2135a12d343876c2ca9fa2ff6c63179f3309 not found: ID does not exist" Jul 02 19:10:57.367011 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.366988 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797c4dd776-wvrfv"] Jul 02 19:10:57.375117 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.375086 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797c4dd776-wvrfv"] Jul 02 19:10:57.746947 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.746863 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w"] Jul 02 19:10:57.747249 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747237 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="extract" Jul 02 19:10:57.747288 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747251 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="extract" Jul 02 19:10:57.747288 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747259 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="pull" Jul 02 19:10:57.747288 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747265 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="pull" Jul 02 19:10:57.747288 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747274 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="extract" Jul 02 19:10:57.747288 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747280 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="extract" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747296 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747301 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747307 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747312 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747318 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="pull" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747323 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="pull" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747329 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="pull" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747334 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="pull" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747339 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="extract" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747343 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="extract" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747351 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747356 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747362 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747366 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="util" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747373 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895197f1-4209-440b-aef3-2d53dfd96cf3" containerName="console" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747378 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="895197f1-4209-440b-aef3-2d53dfd96cf3" containerName="console" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747383 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="extract" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747388 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="extract" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747395 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="pull" Jul 02 19:10:57.747435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747399 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="pull" Jul 02 19:10:57.748028 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747450 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="895197f1-4209-440b-aef3-2d53dfd96cf3" containerName="console" Jul 02 19:10:57.748028 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747460 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d783fcb-dd19-4a91-9967-be33d8003460" containerName="extract" Jul 02 19:10:57.748028 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747466 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="068c12e5-606d-4f74-b2f9-165a3a223df7" containerName="extract" Jul 02 19:10:57.748028 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747473 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a518d23-2659-48d2-9e7b-5f81a537a99d" containerName="extract" Jul 02 19:10:57.748028 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.747479 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b17188d-ac54-443b-adf1-3e3a6dcf75cb" containerName="extract" Jul 02 19:10:57.751808 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.751772 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:10:57.755679 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.755660 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qbbpf\"" Jul 02 19:10:57.756616 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.756600 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 19:10:57.774706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.774681 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w"] Jul 02 19:10:57.885036 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.885006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwj2\" (UniqueName: \"kubernetes.io/projected/c61ad024-d5fe-4467-b372-afb51cb32b8a-kube-api-access-kkwj2\") pod \"dns-operator-controller-manager-864dd78c4c-lj58w\" (UID: \"c61ad024-d5fe-4467-b372-afb51cb32b8a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:10:57.986102 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.986067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwj2\" (UniqueName: \"kubernetes.io/projected/c61ad024-d5fe-4467-b372-afb51cb32b8a-kube-api-access-kkwj2\") pod \"dns-operator-controller-manager-864dd78c4c-lj58w\" (UID: \"c61ad024-d5fe-4467-b372-afb51cb32b8a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:10:57.995178 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:57.995139 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwj2\" (UniqueName: \"kubernetes.io/projected/c61ad024-d5fe-4467-b372-afb51cb32b8a-kube-api-access-kkwj2\") pod \"dns-operator-controller-manager-864dd78c4c-lj58w\" (UID: \"c61ad024-d5fe-4467-b372-afb51cb32b8a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:10:58.061665 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:58.061642 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:10:58.071255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:58.071223 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="895197f1-4209-440b-aef3-2d53dfd96cf3" path="/var/lib/kubelet/pods/895197f1-4209-440b-aef3-2d53dfd96cf3/volumes" Jul 02 19:10:58.203183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:58.203158 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w"] Jul 02 19:10:58.205427 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:10:58.205401 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61ad024_d5fe_4467_b372_afb51cb32b8a.slice/crio-36d2ec63ad791db97d51fd0757c6c70902b4a647d9e88ba272398d4398fb1bf9 WatchSource:0}: Error finding container 36d2ec63ad791db97d51fd0757c6c70902b4a647d9e88ba272398d4398fb1bf9: Status 404 returned error can't find the container with id 36d2ec63ad791db97d51fd0757c6c70902b4a647d9e88ba272398d4398fb1bf9 Jul 02 19:10:58.331526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:58.331423 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" event={"ID":"c61ad024-d5fe-4467-b372-afb51cb32b8a","Type":"ContainerStarted","Data":"36d2ec63ad791db97d51fd0757c6c70902b4a647d9e88ba272398d4398fb1bf9"} Jul 02 19:10:58.507312 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:58.507278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:59.325277 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:10:59.325242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:00.346858 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:00.346826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" event={"ID":"c61ad024-d5fe-4467-b372-afb51cb32b8a","Type":"ContainerStarted","Data":"64dd0b871a13cb78e661fb7feae93d80c3bfcf08cc93339bac22ee73acea7676"} Jul 02 19:11:00.347233 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:00.346920 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:11:00.364975 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:00.364927 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" podStartSLOduration=1.414946357 podStartE2EDuration="3.364913356s" totalImagesPullingTime="1.949966999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:00.362848775 +0000 UTC m=+452.898606312" watchObservedRunningTime="2026-07-02 19:11:00.364913356 +0000 UTC m=+452.900670856" Jul 02 19:11:01.841555 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:01.841519 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m"] Jul 02 19:11:01.845160 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:01.845141 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:01.848664 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:01.848642 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lc8kw\"" Jul 02 19:11:01.884430 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:01.884400 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m"] Jul 02 19:11:01.923899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:01.923861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvdd\" (UniqueName: \"kubernetes.io/projected/b26e5773-ff7e-4c5c-a035-89f055f44d9e-kube-api-access-sgvdd\") pod \"authorino-operator-75cc8d5cb7-m9g9m\" (UID: \"b26e5773-ff7e-4c5c-a035-89f055f44d9e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:02.024648 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.024614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvdd\" (UniqueName: \"kubernetes.io/projected/b26e5773-ff7e-4c5c-a035-89f055f44d9e-kube-api-access-sgvdd\") pod \"authorino-operator-75cc8d5cb7-m9g9m\" (UID: \"b26e5773-ff7e-4c5c-a035-89f055f44d9e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:02.035073 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.035043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvdd\" (UniqueName: \"kubernetes.io/projected/b26e5773-ff7e-4c5c-a035-89f055f44d9e-kube-api-access-sgvdd\") pod \"authorino-operator-75cc8d5cb7-m9g9m\" (UID: \"b26e5773-ff7e-4c5c-a035-89f055f44d9e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:02.156124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.156039 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:02.296541 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.296509 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m"] Jul 02 19:11:02.297646 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:11:02.297617 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26e5773_ff7e_4c5c_a035_89f055f44d9e.slice/crio-c72618342378b4ad574453072524c275d63e34334979393777544e0479854986 WatchSource:0}: Error finding container c72618342378b4ad574453072524c275d63e34334979393777544e0479854986: Status 404 returned error can't find the container with id c72618342378b4ad574453072524c275d63e34334979393777544e0479854986 Jul 02 19:11:02.361031 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.360998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" event={"ID":"b26e5773-ff7e-4c5c-a035-89f055f44d9e","Type":"ContainerStarted","Data":"c72618342378b4ad574453072524c275d63e34334979393777544e0479854986"} Jul 02 19:11:02.814051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.814014 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:02.938072 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:02.938038 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:04.852982 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:04.852947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:05.380534 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:05.380494 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" event={"ID":"b26e5773-ff7e-4c5c-a035-89f055f44d9e","Type":"ContainerStarted","Data":"18b27789d8a6f25ff3b6fb0a4435831ad62eb1739d9fd421d0202780bbd06796"} Jul 02 19:11:05.380754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:05.380623 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:05.426350 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:05.426292 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" podStartSLOduration=2.067313408 podStartE2EDuration="4.426276109s" totalImagesPullingTime="2.358962701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:05.423610821 +0000 UTC m=+457.959368342" watchObservedRunningTime="2026-07-02 19:11:05.426276109 +0000 UTC m=+457.962033609" Jul 02 19:11:05.945116 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:05.945085 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:06.106073 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:06.105959 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:07.772872 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:07.772830 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:10.924152 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:10.924113 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:11.025766 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:11.025725 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:11.354209 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:11.354181 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lj58w" Jul 02 19:11:16.345474 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:16.345437 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:16.389630 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:16.389603 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9g9m" Jul 02 19:11:16.413183 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:16.413147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:16.732486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:16.732397 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:16.837684 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:16.837653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:19.408916 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.408879 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b"] Jul 02 19:11:19.413321 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.413299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.416447 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.416423 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfbmt\"" Jul 02 19:11:19.416447 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.416441 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 02 19:11:19.416630 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.416463 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 02 19:11:19.425364 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.425338 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b"] Jul 02 19:11:19.427453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.427425 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:19.485053 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.485020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.485231 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.485125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.485231 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.485177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8cx\" (UniqueName: \"kubernetes.io/projected/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-kube-api-access-hn8cx\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.586111 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.586078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8cx\" (UniqueName: \"kubernetes.io/projected/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-kube-api-access-hn8cx\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.586285 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.586128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.586285 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.586189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.586756 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.586732 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.588582 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.588560 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.594313 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.594290 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8cx\" (UniqueName: \"kubernetes.io/projected/a7cf19eb-af20-4f9f-a025-5d4efb7879c5-kube-api-access-hn8cx\") pod \"kuadrant-console-plugin-66b5774985-qp47b\" (UID: \"a7cf19eb-af20-4f9f-a025-5d4efb7879c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.602800 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.602743 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:19.724420 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.724336 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" Jul 02 19:11:19.864909 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:19.864878 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b"] Jul 02 19:11:19.867354 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:11:19.867325 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7cf19eb_af20_4f9f_a025_5d4efb7879c5.slice/crio-93c7778f2b7523b77bde20f1801b0ba395294f57aa490ef6da9ff3d7e93ef4bd WatchSource:0}: Error finding container 93c7778f2b7523b77bde20f1801b0ba395294f57aa490ef6da9ff3d7e93ef4bd: Status 404 returned error can't find the container with id 93c7778f2b7523b77bde20f1801b0ba395294f57aa490ef6da9ff3d7e93ef4bd Jul 02 19:11:20.463234 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:20.463192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" event={"ID":"a7cf19eb-af20-4f9f-a025-5d4efb7879c5","Type":"ContainerStarted","Data":"93c7778f2b7523b77bde20f1801b0ba395294f57aa490ef6da9ff3d7e93ef4bd"} Jul 02 19:11:20.505153 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:20.505092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:20.608490 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:20.608439 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:22.878188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:22.878151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:22.982727 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:22.982694 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:30.407707 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.407658 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5"] Jul 02 19:11:30.427486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.427460 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.430740 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.430545 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mb6l4\"" Jul 02 19:11:30.431647 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.431621 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5"] Jul 02 19:11:30.496271 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.496237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2wtt\" (UniqueName: \"kubernetes.io/projected/1f9fdeab-ce9c-4a07-bb91-db4a49af9d32-kube-api-access-m2wtt\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" (UID: \"1f9fdeab-ce9c-4a07-bb91-db4a49af9d32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.496446 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.496368 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f9fdeab-ce9c-4a07-bb91-db4a49af9d32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" (UID: \"1f9fdeab-ce9c-4a07-bb91-db4a49af9d32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.505720 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.505687 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5"] Jul 02 19:11:30.506074 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:11:30.506049 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-m2wtt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" Jul 02 19:11:30.512758 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.512700 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5"] Jul 02 19:11:30.532152 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.532127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.535201 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:11:30.535167 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" is forbidden: User \"system:node:ip-10-0-137-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-48.ec2.internal' and this object" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.541130 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.541109 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.544549 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:11:30.544522 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" is forbidden: User \"system:node:ip-10-0-137-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-48.ec2.internal' and this object" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.575206 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.575174 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz"] Jul 02 19:11:30.579326 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.579305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.589720 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:11:30.589660 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" is forbidden: User \"system:node:ip-10-0-137-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-48.ec2.internal' and this object" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:30.597480 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.597445 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2wtt\" (UniqueName: \"kubernetes.io/projected/1f9fdeab-ce9c-4a07-bb91-db4a49af9d32-kube-api-access-m2wtt\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:11:30.597480 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.597473 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f9fdeab-ce9c-4a07-bb91-db4a49af9d32-extensions-socket-volume\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:11:30.616263 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.615597 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz"] Jul 02 19:11:30.698052 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.697956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c379e3fb-1475-457b-ac91-8915c0324c07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m5qgz\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.698219 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.698085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlt5\" (UniqueName: \"kubernetes.io/projected/c379e3fb-1475-457b-ac91-8915c0324c07-kube-api-access-4xlt5\") pod \"kuadrant-operator-controller-manager-86878c769f-m5qgz\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.799323 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.799282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c379e3fb-1475-457b-ac91-8915c0324c07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m5qgz\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.799500 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.799373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlt5\" (UniqueName: \"kubernetes.io/projected/c379e3fb-1475-457b-ac91-8915c0324c07-kube-api-access-4xlt5\") pod \"kuadrant-operator-controller-manager-86878c769f-m5qgz\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.799730 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.799686 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c379e3fb-1475-457b-ac91-8915c0324c07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m5qgz\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.814721 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.814691 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlt5\" (UniqueName: \"kubernetes.io/projected/c379e3fb-1475-457b-ac91-8915c0324c07-kube-api-access-4xlt5\") pod \"kuadrant-operator-controller-manager-86878c769f-m5qgz\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:30.892353 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:30.892320 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:31.538337 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:31.538299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:31.541854 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:11:31.541808 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" is forbidden: User \"system:node:ip-10-0-137-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-48.ec2.internal' and this object" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:31.548473 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:11:31.548439 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxwq5\" is forbidden: User \"system:node:ip-10-0-137-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-48.ec2.internal' and this object" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwq5" Jul 02 19:11:31.939071 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:31.938987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:32.060079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:32.060041 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:32.073615 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:32.073554 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f9fdeab-ce9c-4a07-bb91-db4a49af9d32" path="/var/lib/kubelet/pods/1f9fdeab-ce9c-4a07-bb91-db4a49af9d32/volumes" Jul 02 19:11:37.852472 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:37.852434 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:37.918216 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:37.918165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:38.256629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:38.256534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:38.337318 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:38.337278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:39.852764 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:39.852718 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:39.921748 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:39.921711 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:41.511064 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:41.511026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:41.619667 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:41.619622 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:43.142037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:43.142001 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz"] Jul 02 19:11:43.150675 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:11:43.150639 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc379e3fb_1475_457b_ac91_8915c0324c07.slice/crio-401ca4a3f45635c129b53f0ff3c5c7715c4befc540c9f98d3c0104a2e63078ed WatchSource:0}: Error finding container 401ca4a3f45635c129b53f0ff3c5c7715c4befc540c9f98d3c0104a2e63078ed: Status 404 returned error can't find the container with id 401ca4a3f45635c129b53f0ff3c5c7715c4befc540c9f98d3c0104a2e63078ed Jul 02 19:11:43.615855 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:43.615810 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" event={"ID":"a7cf19eb-af20-4f9f-a025-5d4efb7879c5","Type":"ContainerStarted","Data":"b29c861fd5a7da2c4daaec76d914fcb9621d227814c4f1635810ac0374099762"} Jul 02 19:11:43.617063 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:43.617035 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" event={"ID":"c379e3fb-1475-457b-ac91-8915c0324c07","Type":"ContainerStarted","Data":"401ca4a3f45635c129b53f0ff3c5c7715c4befc540c9f98d3c0104a2e63078ed"} Jul 02 19:11:43.640951 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:43.640889 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qp47b" podStartSLOduration=1.4582918679999999 podStartE2EDuration="24.640872383s" totalImagesPullingTime="23.182580515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:43.638832115 +0000 UTC m=+496.174589613" watchObservedRunningTime="2026-07-02 19:11:43.640872383 +0000 UTC m=+496.176629890" Jul 02 19:11:45.193948 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:45.193911 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:45.287837 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:45.287801 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:48.648013 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:48.647907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" event={"ID":"c379e3fb-1475-457b-ac91-8915c0324c07","Type":"ContainerStarted","Data":"6af3503250b360452f2f8ec5638bf115da1fc450dc338476b5a82a44ecc58e9d"} Jul 02 19:11:48.648451 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:48.648068 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:11:48.674437 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:48.674380 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" podStartSLOduration=13.457849243 podStartE2EDuration="18.67436514s" totalImagesPullingTime="5.216515897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:48.673472605 +0000 UTC m=+501.209230141" watchObservedRunningTime="2026-07-02 19:11:48.67436514 +0000 UTC m=+501.210122641" Jul 02 19:11:59.655929 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:11:59.655896 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:12:16.156061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:16.156015 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:16.463034 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:16.462936 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:17.919419 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:17.919378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:18.084768 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:18.084723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:18.820312 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:18.820269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:18.917541 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:18.917493 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:39.021586 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:39.021493 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:39.110196 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:39.110151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:39.527462 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:39.527418 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:50.773830 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:50.773764 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:50.852468 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:50.852429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:52.236871 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:52.236807 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:52.490730 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:52.490644 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:58.362002 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:58.361965 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:58.457929 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:58.457895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:58.518196 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:58.518158 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:58.588631 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:12:58.588590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:01.458561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:01.458496 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:01.614237 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:01.614199 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:12.465533 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:12.465500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:12.566341 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:12.566309 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:27.973038 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:27.973011 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:13:27.973662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:27.973640 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:13:27.976390 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:27.976368 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:13:27.977029 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:27.977007 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:13:32.826018 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:32.825978 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:33.311638 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:33.311601 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:33.680763 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:33.680667 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:34.214349 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.214301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:34.319838 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.319803 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-jtxlz"] Jul 02 19:13:34.321330 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.321301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:34.322629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.322613 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.327480 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.327459 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 19:13:34.336969 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.336947 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-jtxlz"] Jul 02 19:13:34.506168 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.506090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6vvd\" (UniqueName: \"kubernetes.io/projected/d05e450c-0106-4da6-a1d5-f393d2e7dc7b-kube-api-access-h6vvd\") pod \"payload-pre-processing-7964457696-jtxlz\" (UID: \"d05e450c-0106-4da6-a1d5-f393d2e7dc7b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.506168 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.506137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d05e450c-0106-4da6-a1d5-f393d2e7dc7b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-jtxlz\" (UID: \"d05e450c-0106-4da6-a1d5-f393d2e7dc7b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.607407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.607370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6vvd\" (UniqueName: \"kubernetes.io/projected/d05e450c-0106-4da6-a1d5-f393d2e7dc7b-kube-api-access-h6vvd\") pod \"payload-pre-processing-7964457696-jtxlz\" (UID: \"d05e450c-0106-4da6-a1d5-f393d2e7dc7b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.607556 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.607415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d05e450c-0106-4da6-a1d5-f393d2e7dc7b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-jtxlz\" (UID: \"d05e450c-0106-4da6-a1d5-f393d2e7dc7b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.608132 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.608111 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d05e450c-0106-4da6-a1d5-f393d2e7dc7b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-jtxlz\" (UID: \"d05e450c-0106-4da6-a1d5-f393d2e7dc7b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.616754 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.616736 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6vvd\" (UniqueName: \"kubernetes.io/projected/d05e450c-0106-4da6-a1d5-f393d2e7dc7b-kube-api-access-h6vvd\") pod \"payload-pre-processing-7964457696-jtxlz\" (UID: \"d05e450c-0106-4da6-a1d5-f393d2e7dc7b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.632595 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.632564 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:34.785927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:34.785900 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-jtxlz"] Jul 02 19:13:34.787248 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:13:34.787223 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05e450c_0106_4da6_a1d5_f393d2e7dc7b.slice/crio-82e43cb088126afc2e8409386aad4726692f0b43e9c2b34ed6f349d8de06feed WatchSource:0}: Error finding container 82e43cb088126afc2e8409386aad4726692f0b43e9c2b34ed6f349d8de06feed: Status 404 returned error can't find the container with id 82e43cb088126afc2e8409386aad4726692f0b43e9c2b34ed6f349d8de06feed Jul 02 19:13:35.237513 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:35.237479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" event={"ID":"d05e450c-0106-4da6-a1d5-f393d2e7dc7b","Type":"ContainerStarted","Data":"82e43cb088126afc2e8409386aad4726692f0b43e9c2b34ed6f349d8de06feed"} Jul 02 19:13:37.249564 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:37.249530 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" event={"ID":"d05e450c-0106-4da6-a1d5-f393d2e7dc7b","Type":"ContainerStarted","Data":"765f6e82f5b0715663a41e1b0f305525148c4b4ab5d4cb754c86e3939e82a165"} Jul 02 19:13:37.249969 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:37.249655 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:37.266579 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:37.266530 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" podStartSLOduration=1.62930499 podStartE2EDuration="3.266513239s" totalImagesPullingTime="1.637208249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:37.264903334 +0000 UTC m=+609.800660836" watchObservedRunningTime="2026-07-02 19:13:37.266513239 +0000 UTC m=+609.802270743" Jul 02 19:13:41.985526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:41.985494 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:42.041241 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:42.041211 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:43.112291 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:43.112253 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:44.322439 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:44.322406 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:48.257702 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:48.257668 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-jtxlz" Jul 02 19:13:51.438424 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:51.438332 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:59.643885 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:13:59.643842 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:13.549659 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.549623 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq"] Jul 02 19:14:13.552624 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.552608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.555387 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.555362 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 19:14:13.555387 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.555374 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t76xx\"" Jul 02 19:14:13.556378 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.556364 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 19:14:13.556501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.556476 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 19:14:13.564200 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.564181 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq"] Jul 02 19:14:13.631480 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.631450 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e521154-8a18-42b9-b416-3f9e931eea46-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.631600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.631547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbhvb\" (UniqueName: \"kubernetes.io/projected/3e521154-8a18-42b9-b416-3f9e931eea46-kube-api-access-jbhvb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.631600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.631580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.631600 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.631596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.631760 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.631626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.631760 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.631718 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.648328 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.648303 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:13.732845 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.732822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbhvb\" (UniqueName: \"kubernetes.io/projected/3e521154-8a18-42b9-b416-3f9e931eea46-kube-api-access-jbhvb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.732956 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.732859 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.732956 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.732877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.733053 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.732986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.733099 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.733052 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.733154 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.733096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e521154-8a18-42b9-b416-3f9e931eea46-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.733313 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.733297 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.733378 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.733332 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.733421 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.733407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.735116 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.735093 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e521154-8a18-42b9-b416-3f9e931eea46-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.735355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.735340 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e521154-8a18-42b9-b416-3f9e931eea46-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.740869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.740848 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbhvb\" (UniqueName: \"kubernetes.io/projected/3e521154-8a18-42b9-b416-3f9e931eea46-kube-api-access-jbhvb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zk8xq\" (UID: \"3e521154-8a18-42b9-b416-3f9e931eea46\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.863213 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.863160 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:13.994457 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.994435 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq"] Jul 02 19:14:13.996190 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:14:13.996148 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e521154_8a18_42b9_b416_3f9e931eea46.slice/crio-71da86bd6c7da539152765173b273dece0e6c736ecf0eeec1dbc387c93d56f4b WatchSource:0}: Error finding container 71da86bd6c7da539152765173b273dece0e6c736ecf0eeec1dbc387c93d56f4b: Status 404 returned error can't find the container with id 71da86bd6c7da539152765173b273dece0e6c736ecf0eeec1dbc387c93d56f4b Jul 02 19:14:13.997576 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:13.997555 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:14:14.459285 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:14.459239 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" event={"ID":"3e521154-8a18-42b9-b416-3f9e931eea46","Type":"ContainerStarted","Data":"71da86bd6c7da539152765173b273dece0e6c736ecf0eeec1dbc387c93d56f4b"} Jul 02 19:14:15.466416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:15.466335 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" event={"ID":"3e521154-8a18-42b9-b416-3f9e931eea46","Type":"ContainerStarted","Data":"f57f69af648819842b328d440e3885e42c2b47823b926c5beb5fa001b600f1b2"} Jul 02 19:14:15.485671 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:15.485615 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" podStartSLOduration=1.359653763 podStartE2EDuration="2.485599856s" totalImagesPullingTime="1.125946093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:15.4828339 +0000 UTC m=+648.018591446" watchObservedRunningTime="2026-07-02 19:14:15.485599856 +0000 UTC m=+648.021357371" Jul 02 19:14:23.863669 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:23.863634 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:23.864061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:23.863698 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:23.875502 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:23.875480 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:24.523559 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:24.523533 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zk8xq" Jul 02 19:14:35.174070 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:35.174028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:43.590335 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:43.590295 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:54.671931 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:54.671900 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:55.383360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:55.383331 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:58.409773 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:14:58.409738 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:15:00.145919 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.145888 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv"] Jul 02 19:15:00.148448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.148432 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:15:00.152456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.152435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 02 19:15:00.153361 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.153346 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g6bdc\"" Jul 02 19:15:00.153429 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.153377 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 02 19:15:00.165404 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.165383 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv"] Jul 02 19:15:00.186208 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.186177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjvvd\" (UniqueName: \"kubernetes.io/projected/5c1f42e2-930f-4677-8248-254291274050-kube-api-access-cjvvd\") pod \"maas-api-key-cleanup-29716995-zhctv\" (UID: \"5c1f42e2-930f-4677-8248-254291274050\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:15:00.287137 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.287105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjvvd\" (UniqueName: \"kubernetes.io/projected/5c1f42e2-930f-4677-8248-254291274050-kube-api-access-cjvvd\") pod \"maas-api-key-cleanup-29716995-zhctv\" (UID: \"5c1f42e2-930f-4677-8248-254291274050\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:15:00.299732 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.299703 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjvvd\" (UniqueName: \"kubernetes.io/projected/5c1f42e2-930f-4677-8248-254291274050-kube-api-access-cjvvd\") pod \"maas-api-key-cleanup-29716995-zhctv\" (UID: \"5c1f42e2-930f-4677-8248-254291274050\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:15:00.458053 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.457985 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:15:00.600855 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.600829 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv"] Jul 02 19:15:00.602131 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:15:00.602102 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1f42e2_930f_4677_8248_254291274050.slice/crio-da66b2149fa4cd3a2da852b2d93709725a778f4c6e58873f5bdb637c5abaac51 WatchSource:0}: Error finding container da66b2149fa4cd3a2da852b2d93709725a778f4c6e58873f5bdb637c5abaac51: Status 404 returned error can't find the container with id da66b2149fa4cd3a2da852b2d93709725a778f4c6e58873f5bdb637c5abaac51 Jul 02 19:15:00.705093 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:00.705055 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" event={"ID":"5c1f42e2-930f-4677-8248-254291274050","Type":"ContainerStarted","Data":"da66b2149fa4cd3a2da852b2d93709725a778f4c6e58873f5bdb637c5abaac51"} Jul 02 19:15:03.725267 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:03.725232 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" event={"ID":"5c1f42e2-930f-4677-8248-254291274050","Type":"ContainerStarted","Data":"65a8309b7117f5eb581dd6685fdc89a09e8f8696f8b1a0a2f47f833065a91e76"} Jul 02 19:15:03.761367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:15:03.761318 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" podStartSLOduration=1.678685066 podStartE2EDuration="3.761303826s" totalImagesPullingTime="2.08261876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:15:03.75815754 +0000 UTC m=+696.293915062" watchObservedRunningTime="2026-07-02 19:15:03.761303826 +0000 UTC m=+696.297061326" Jul 02 19:16:00.010610 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:00.010568 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv"] Jul 02 19:16:00.011185 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:00.010815 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" podUID="5c1f42e2-930f-4677-8248-254291274050" containerName="cleanup" containerID="cri-o://65a8309b7117f5eb581dd6685fdc89a09e8f8696f8b1a0a2f47f833065a91e76" gracePeriod=30 Jul 02 19:16:11.035919 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:11.035879 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:11.132353 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:11.132311 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:12.186189 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:12.186131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:12.277979 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:12.277934 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:30.200368 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:30.200336 2582 generic.go:356] "Generic (PLEG): container finished" podID="5c1f42e2-930f-4677-8248-254291274050" containerID="65a8309b7117f5eb581dd6685fdc89a09e8f8696f8b1a0a2f47f833065a91e76" exitCode=137 Jul 02 19:16:30.200725 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:30.200402 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" event={"ID":"5c1f42e2-930f-4677-8248-254291274050","Type":"ContainerDied","Data":"65a8309b7117f5eb581dd6685fdc89a09e8f8696f8b1a0a2f47f833065a91e76"} Jul 02 19:16:30.219474 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:30.219448 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:16:30.284987 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:30.284896 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjvvd\" (UniqueName: \"kubernetes.io/projected/5c1f42e2-930f-4677-8248-254291274050-kube-api-access-cjvvd\") pod \"5c1f42e2-930f-4677-8248-254291274050\" (UID: \"5c1f42e2-930f-4677-8248-254291274050\") " Jul 02 19:16:30.287152 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:30.287123 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1f42e2-930f-4677-8248-254291274050-kube-api-access-cjvvd" (OuterVolumeSpecName: "kube-api-access-cjvvd") pod "5c1f42e2-930f-4677-8248-254291274050" (UID: "5c1f42e2-930f-4677-8248-254291274050"). InnerVolumeSpecName "kube-api-access-cjvvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:16:30.386191 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:30.386155 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjvvd\" (UniqueName: \"kubernetes.io/projected/5c1f42e2-930f-4677-8248-254291274050-kube-api-access-cjvvd\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:16:31.207573 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:31.207541 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" Jul 02 19:16:31.208133 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:31.207579 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv" event={"ID":"5c1f42e2-930f-4677-8248-254291274050","Type":"ContainerDied","Data":"da66b2149fa4cd3a2da852b2d93709725a778f4c6e58873f5bdb637c5abaac51"} Jul 02 19:16:31.208133 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:31.207642 2582 scope.go:117] "RemoveContainer" containerID="65a8309b7117f5eb581dd6685fdc89a09e8f8696f8b1a0a2f47f833065a91e76" Jul 02 19:16:31.230203 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:31.230167 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv"] Jul 02 19:16:31.235837 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:31.235812 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29716995-zhctv"] Jul 02 19:16:32.072679 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:32.072641 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1f42e2-930f-4677-8248-254291274050" path="/var/lib/kubelet/pods/5c1f42e2-930f-4677-8248-254291274050/volumes" Jul 02 19:16:33.442065 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:16:33.442032 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:00.846316 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:17:00.846238 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:24.882266 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:17:24.882225 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:25.188157 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:17:25.188062 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:25.263052 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:17:25.263014 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:26.832231 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:17:26.832195 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:02.589614 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:02.589556 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:02.690078 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:02.690048 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:02.903869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:02.903746 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:08.855460 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:08.855414 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:08.936795 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:08.936751 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:09.063306 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:09.063238 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:09.218368 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:09.218267 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:09.373763 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:09.373723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:15.021618 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:15.021565 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:15.122399 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:15.122365 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:28.010143 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:28.010060 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:18:28.013520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:28.013498 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:18:28.014559 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:28.014537 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:18:28.017101 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:18:28.017085 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:22:06.194833 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:06.194768 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:22:07.863062 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:07.863030 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz"] Jul 02 19:22:07.863469 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:07.863204 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" podUID="c379e3fb-1475-457b-ac91-8915c0324c07" containerName="manager" containerID="cri-o://6af3503250b360452f2f8ec5638bf115da1fc450dc338476b5a82a44ecc58e9d" gracePeriod=10 Jul 02 19:22:11.084927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.084890 2582 generic.go:356] "Generic (PLEG): container finished" podID="c379e3fb-1475-457b-ac91-8915c0324c07" containerID="6af3503250b360452f2f8ec5638bf115da1fc450dc338476b5a82a44ecc58e9d" exitCode=0 Jul 02 19:22:11.085284 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.084958 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" event={"ID":"c379e3fb-1475-457b-ac91-8915c0324c07","Type":"ContainerDied","Data":"6af3503250b360452f2f8ec5638bf115da1fc450dc338476b5a82a44ecc58e9d"} Jul 02 19:22:11.127535 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.127509 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:22:11.233113 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.233015 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xlt5\" (UniqueName: \"kubernetes.io/projected/c379e3fb-1475-457b-ac91-8915c0324c07-kube-api-access-4xlt5\") pod \"c379e3fb-1475-457b-ac91-8915c0324c07\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " Jul 02 19:22:11.233278 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.233126 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c379e3fb-1475-457b-ac91-8915c0324c07-extensions-socket-volume\") pod \"c379e3fb-1475-457b-ac91-8915c0324c07\" (UID: \"c379e3fb-1475-457b-ac91-8915c0324c07\") " Jul 02 19:22:11.233503 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.233477 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c379e3fb-1475-457b-ac91-8915c0324c07-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c379e3fb-1475-457b-ac91-8915c0324c07" (UID: "c379e3fb-1475-457b-ac91-8915c0324c07"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:22:11.235227 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.235201 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c379e3fb-1475-457b-ac91-8915c0324c07-kube-api-access-4xlt5" (OuterVolumeSpecName: "kube-api-access-4xlt5") pod "c379e3fb-1475-457b-ac91-8915c0324c07" (UID: "c379e3fb-1475-457b-ac91-8915c0324c07"). InnerVolumeSpecName "kube-api-access-4xlt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:22:11.334556 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.334516 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c379e3fb-1475-457b-ac91-8915c0324c07-extensions-socket-volume\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:22:11.334556 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:11.334546 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xlt5\" (UniqueName: \"kubernetes.io/projected/c379e3fb-1475-457b-ac91-8915c0324c07-kube-api-access-4xlt5\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:22:12.091490 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:12.091460 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" event={"ID":"c379e3fb-1475-457b-ac91-8915c0324c07","Type":"ContainerDied","Data":"401ca4a3f45635c129b53f0ff3c5c7715c4befc540c9f98d3c0104a2e63078ed"} Jul 02 19:22:12.091490 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:12.091485 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz" Jul 02 19:22:12.091929 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:12.091526 2582 scope.go:117] "RemoveContainer" containerID="6af3503250b360452f2f8ec5638bf115da1fc450dc338476b5a82a44ecc58e9d" Jul 02 19:22:12.130429 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:12.130396 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz"] Jul 02 19:22:12.139677 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:12.139646 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5qgz"] Jul 02 19:22:14.073074 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:22:14.073040 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c379e3fb-1475-457b-ac91-8915c0324c07" path="/var/lib/kubelet/pods/c379e3fb-1475-457b-ac91-8915c0324c07/volumes" Jul 02 19:23:09.151190 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151105 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw"] Jul 02 19:23:09.151725 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151705 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c379e3fb-1475-457b-ac91-8915c0324c07" containerName="manager" Jul 02 19:23:09.151825 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151729 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c379e3fb-1475-457b-ac91-8915c0324c07" containerName="manager" Jul 02 19:23:09.151825 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151742 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1f42e2-930f-4677-8248-254291274050" containerName="cleanup" Jul 02 19:23:09.151825 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151750 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1f42e2-930f-4677-8248-254291274050" containerName="cleanup" Jul 02 19:23:09.151984 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151869 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1f42e2-930f-4677-8248-254291274050" containerName="cleanup" Jul 02 19:23:09.151984 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.151888 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c379e3fb-1475-457b-ac91-8915c0324c07" containerName="manager" Jul 02 19:23:09.154090 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.154068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.157655 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.157633 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mb6l4\"" Jul 02 19:23:09.177054 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.177033 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw"] Jul 02 19:23:09.225246 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.225214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f24d898-66ea-4715-a0e8-922ec72027fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bs4dw\" (UID: \"0f24d898-66ea-4715-a0e8-922ec72027fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.225378 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.225250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdpzg\" (UniqueName: \"kubernetes.io/projected/0f24d898-66ea-4715-a0e8-922ec72027fa-kube-api-access-qdpzg\") pod \"kuadrant-operator-controller-manager-86878c769f-bs4dw\" (UID: \"0f24d898-66ea-4715-a0e8-922ec72027fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.326035 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.326007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzg\" (UniqueName: \"kubernetes.io/projected/0f24d898-66ea-4715-a0e8-922ec72027fa-kube-api-access-qdpzg\") pod \"kuadrant-operator-controller-manager-86878c769f-bs4dw\" (UID: \"0f24d898-66ea-4715-a0e8-922ec72027fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.326148 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.326103 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f24d898-66ea-4715-a0e8-922ec72027fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bs4dw\" (UID: \"0f24d898-66ea-4715-a0e8-922ec72027fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.326392 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.326376 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f24d898-66ea-4715-a0e8-922ec72027fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bs4dw\" (UID: \"0f24d898-66ea-4715-a0e8-922ec72027fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.335546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.335523 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdpzg\" (UniqueName: \"kubernetes.io/projected/0f24d898-66ea-4715-a0e8-922ec72027fa-kube-api-access-qdpzg\") pod \"kuadrant-operator-controller-manager-86878c769f-bs4dw\" (UID: \"0f24d898-66ea-4715-a0e8-922ec72027fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.463899 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.463825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:09.601374 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:09.601345 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw"] Jul 02 19:23:09.602823 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:23:09.602774 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f24d898_66ea_4715_a0e8_922ec72027fa.slice/crio-96ae3d98a9ffd78e0a3f896188f44dcc9d2064514418ce8bf80ac94bced80d74 WatchSource:0}: Error finding container 96ae3d98a9ffd78e0a3f896188f44dcc9d2064514418ce8bf80ac94bced80d74: Status 404 returned error can't find the container with id 96ae3d98a9ffd78e0a3f896188f44dcc9d2064514418ce8bf80ac94bced80d74 Jul 02 19:23:10.432465 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:10.432431 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" event={"ID":"0f24d898-66ea-4715-a0e8-922ec72027fa","Type":"ContainerStarted","Data":"2b9be9a16ff0337cf5f520ca48d4a165f953cc6d44e9acbaaf0436c86b727eb5"} Jul 02 19:23:10.432870 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:10.432492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" event={"ID":"0f24d898-66ea-4715-a0e8-922ec72027fa","Type":"ContainerStarted","Data":"96ae3d98a9ffd78e0a3f896188f44dcc9d2064514418ce8bf80ac94bced80d74"} Jul 02 19:23:10.432870 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:10.432518 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:10.463731 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:10.463677 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" podStartSLOduration=1.463662501 podStartE2EDuration="1.463662501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:23:10.461730097 +0000 UTC m=+1182.997487596" watchObservedRunningTime="2026-07-02 19:23:10.463662501 +0000 UTC m=+1182.999420001" Jul 02 19:23:21.440615 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:21.440530 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bs4dw" Jul 02 19:23:28.047047 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:28.047015 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:23:28.050583 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:28.050557 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:23:28.051703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:28.051682 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:23:28.055370 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:28.055354 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:23:39.214518 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:23:39.214473 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:24:32.489023 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:24:32.488995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:24:32.589411 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:24:32.589380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:27:35.589902 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:27:35.589823 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:28:28.086390 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:28:28.086359 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:28:28.090470 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:28:28.090447 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:28:28.093291 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:28:28.093274 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:28:28.096692 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:28:28.096676 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:28:58.968046 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:28:58.967971 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:03.668177 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:03.668117 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:11.920234 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:11.920179 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:17.043423 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:17.043390 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:19.956184 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:19.956153 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:20.054657 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:20.054616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:20.466514 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:20.466482 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:26.165657 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:26.165619 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:26.231426 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:26.231401 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:26.385768 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:26.385737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:26.483521 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:26.483443 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:27.624188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:27.624151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:27.708627 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:27.708576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:27.886501 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:27.886427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:28.015963 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:28.015926 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:28.554571 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:28.554534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:28.661263 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:28.661234 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:29.867669 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:29.867641 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:32.729208 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:32.729177 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:32.908161 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:32.908128 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:33.019624 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:33.019546 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:33.087317 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:33.087288 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:35.965336 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:35.965300 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:39.211188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:39.211140 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:39.271814 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:39.271767 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:39.433554 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:39.433527 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:39.500132 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:39.500059 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:40.628888 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:40.628853 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:40.722125 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:40.722098 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:40.789238 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:40.789205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:41.191553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:41.191523 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:41.293649 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:41.293616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:41.412387 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:41.412354 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:42.866405 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:42.866378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:45.904612 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:45.904582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:46.344187 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:46.344157 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:52.171918 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:52.171888 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:52.279445 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:52.279388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:53.876835 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:53.876774 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:58.257989 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:58.257957 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:58.340058 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:58.340029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:58.490954 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:58.490924 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:58.586956 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:58.586886 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.714126 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:59.714090 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.801476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:29:59.801446 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:00.179184 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.179152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:00.193587 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.193556 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl"] Jul 02 19:30:00.198867 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.198839 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:30:00.201935 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.201911 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz"] Jul 02 19:30:00.202581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.202564 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 02 19:30:00.202647 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.202624 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 02 19:30:00.205302 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.205275 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g6bdc\"" Jul 02 19:30:00.205413 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.205339 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:00.216068 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.216046 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl"] Jul 02 19:30:00.223544 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.223522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqqx\" (UniqueName: \"kubernetes.io/projected/592707b5-e781-486a-9b2d-dcb0a5b1249f-kube-api-access-ppqqx\") pod \"maas-api-key-cleanup-29717010-528xl\" (UID: \"592707b5-e781-486a-9b2d-dcb0a5b1249f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:30:00.223627 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.223561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwhq5\" (UniqueName: \"kubernetes.io/projected/3f7cf929-36ff-4733-9fe4-68c28fdaab33-kube-api-access-rwhq5\") pod \"maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz\" (UID: \"3f7cf929-36ff-4733-9fe4-68c28fdaab33\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:00.230293 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.230271 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz"] Jul 02 19:30:00.324550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.324524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqqx\" (UniqueName: \"kubernetes.io/projected/592707b5-e781-486a-9b2d-dcb0a5b1249f-kube-api-access-ppqqx\") pod \"maas-api-key-cleanup-29717010-528xl\" (UID: \"592707b5-e781-486a-9b2d-dcb0a5b1249f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:30:00.324709 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.324563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwhq5\" (UniqueName: \"kubernetes.io/projected/3f7cf929-36ff-4733-9fe4-68c28fdaab33-kube-api-access-rwhq5\") pod \"maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz\" (UID: \"3f7cf929-36ff-4733-9fe4-68c28fdaab33\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:00.336572 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.336543 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwhq5\" (UniqueName: \"kubernetes.io/projected/3f7cf929-36ff-4733-9fe4-68c28fdaab33-kube-api-access-rwhq5\") pod \"maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz\" (UID: \"3f7cf929-36ff-4733-9fe4-68c28fdaab33\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:00.337099 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.337081 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqqx\" (UniqueName: \"kubernetes.io/projected/592707b5-e781-486a-9b2d-dcb0a5b1249f-kube-api-access-ppqqx\") pod \"maas-api-key-cleanup-29717010-528xl\" (UID: \"592707b5-e781-486a-9b2d-dcb0a5b1249f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:30:00.509256 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.509175 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:30:00.518354 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.518326 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:00.686550 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.686516 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl"] Jul 02 19:30:00.692122 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:30:00.692087 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592707b5_e781_486a_9b2d_dcb0a5b1249f.slice/crio-7132da02b2d02315e1caa43e359948e343779400ce3b0e94400bc2cb1ceee394 WatchSource:0}: Error finding container 7132da02b2d02315e1caa43e359948e343779400ce3b0e94400bc2cb1ceee394: Status 404 returned error can't find the container with id 7132da02b2d02315e1caa43e359948e343779400ce3b0e94400bc2cb1ceee394 Jul 02 19:30:00.693997 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.693975 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz"] Jul 02 19:30:00.694206 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:30:00.694181 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7cf929_36ff_4733_9fe4_68c28fdaab33.slice/crio-7cb1aceed8008ebacc88d27952270693c5a870216a0fbc8af2e543932386e3aa WatchSource:0}: Error finding container 7cb1aceed8008ebacc88d27952270693c5a870216a0fbc8af2e543932386e3aa: Status 404 returned error can't find the container with id 7cb1aceed8008ebacc88d27952270693c5a870216a0fbc8af2e543932386e3aa Jul 02 19:30:00.777902 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.777842 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:00.970559 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:00.970532 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:01.684896 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.684820 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" event={"ID":"592707b5-e781-486a-9b2d-dcb0a5b1249f","Type":"ContainerStarted","Data":"e0b7912798ea971dae128ceed5ff77aba8e21540046d2c7e9b1969802d77cac5"} Jul 02 19:30:01.684896 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.684875 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" event={"ID":"592707b5-e781-486a-9b2d-dcb0a5b1249f","Type":"ContainerStarted","Data":"7132da02b2d02315e1caa43e359948e343779400ce3b0e94400bc2cb1ceee394"} Jul 02 19:30:01.686448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.686426 2582 generic.go:356] "Generic (PLEG): container finished" podID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerID="0370dc0419a614de90897e4274341fa3cc02cd28bb753988f257e3de96e58fe1" exitCode=7 Jul 02 19:30:01.686564 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.686480 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" event={"ID":"3f7cf929-36ff-4733-9fe4-68c28fdaab33","Type":"ContainerDied","Data":"0370dc0419a614de90897e4274341fa3cc02cd28bb753988f257e3de96e58fe1"} Jul 02 19:30:01.686564 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.686513 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" event={"ID":"3f7cf929-36ff-4733-9fe4-68c28fdaab33","Type":"ContainerStarted","Data":"7cb1aceed8008ebacc88d27952270693c5a870216a0fbc8af2e543932386e3aa"} Jul 02 19:30:01.686664 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.686653 2582 scope.go:117] "RemoveContainer" containerID="0370dc0419a614de90897e4274341fa3cc02cd28bb753988f257e3de96e58fe1" Jul 02 19:30:01.708927 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.708882 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" podStartSLOduration=1.7088648050000002 podStartE2EDuration="1.708864805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:01.704938641 +0000 UTC m=+1594.240696151" watchObservedRunningTime="2026-07-02 19:30:01.708864805 +0000 UTC m=+1594.244622305" Jul 02 19:30:01.992393 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:01.992368 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:02.693591 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:02.693517 2582 generic.go:356] "Generic (PLEG): container finished" podID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerID="410f3e74687932cdaa168a433cc409df32a296bc05f6f28f0b5c56ad617bfe3b" exitCode=7 Jul 02 19:30:02.693735 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:02.693597 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" event={"ID":"3f7cf929-36ff-4733-9fe4-68c28fdaab33","Type":"ContainerDied","Data":"410f3e74687932cdaa168a433cc409df32a296bc05f6f28f0b5c56ad617bfe3b"} Jul 02 19:30:02.693735 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:02.693653 2582 scope.go:117] "RemoveContainer" containerID="0370dc0419a614de90897e4274341fa3cc02cd28bb753988f257e3de96e58fe1" Jul 02 19:30:02.693911 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:02.693896 2582 scope.go:117] "RemoveContainer" containerID="410f3e74687932cdaa168a433cc409df32a296bc05f6f28f0b5c56ad617bfe3b" Jul 02 19:30:02.694144 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:30:02.694123 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz_odh-ai-gateway-infra(3f7cf929-36ff-4733-9fe4-68c28fdaab33)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" Jul 02 19:30:03.700604 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:03.700575 2582 scope.go:117] "RemoveContainer" containerID="410f3e74687932cdaa168a433cc409df32a296bc05f6f28f0b5c56ad617bfe3b" Jul 02 19:30:03.700988 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:30:03.700749 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz_odh-ai-gateway-infra(3f7cf929-36ff-4733-9fe4-68c28fdaab33)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" Jul 02 19:30:04.188432 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.188399 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:04.374769 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.374736 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:04.473491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.473422 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:04.634456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.634429 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz"] Jul 02 19:30:04.724882 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.724808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:04.840852 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.840822 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:04.966191 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.966163 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwhq5\" (UniqueName: \"kubernetes.io/projected/3f7cf929-36ff-4733-9fe4-68c28fdaab33-kube-api-access-rwhq5\") pod \"3f7cf929-36ff-4733-9fe4-68c28fdaab33\" (UID: \"3f7cf929-36ff-4733-9fe4-68c28fdaab33\") " Jul 02 19:30:04.968058 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:04.968038 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f7cf929-36ff-4733-9fe4-68c28fdaab33-kube-api-access-rwhq5" (OuterVolumeSpecName: "kube-api-access-rwhq5") pod "3f7cf929-36ff-4733-9fe4-68c28fdaab33" (UID: "3f7cf929-36ff-4733-9fe4-68c28fdaab33"). InnerVolumeSpecName "kube-api-access-rwhq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:30:05.067830 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:05.067800 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwhq5\" (UniqueName: \"kubernetes.io/projected/3f7cf929-36ff-4733-9fe4-68c28fdaab33-kube-api-access-rwhq5\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:30:05.711873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:05.711842 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" Jul 02 19:30:05.711873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:05.711859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz" event={"ID":"3f7cf929-36ff-4733-9fe4-68c28fdaab33","Type":"ContainerDied","Data":"7cb1aceed8008ebacc88d27952270693c5a870216a0fbc8af2e543932386e3aa"} Jul 02 19:30:05.712100 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:05.711921 2582 scope.go:117] "RemoveContainer" containerID="410f3e74687932cdaa168a433cc409df32a296bc05f6f28f0b5c56ad617bfe3b" Jul 02 19:30:05.736452 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:05.736405 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz"] Jul 02 19:30:05.740264 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:05.740240 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-de3868c8-29717010-x69xz"] Jul 02 19:30:06.071963 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:06.071933 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" path="/var/lib/kubelet/pods/3f7cf929-36ff-4733-9fe4-68c28fdaab33/volumes" Jul 02 19:30:08.057148 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:08.057108 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:10.322432 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:10.322402 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:10.422821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:10.422769 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:10.816984 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:10.816944 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:10.916302 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:10.916263 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:11.016886 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:11.016859 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:12.461720 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:12.461683 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:18.550617 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:18.550584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:18.651479 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:18.651447 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:18.942598 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:18.942524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:44.939748 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:44.939711 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:45.133284 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:45.133236 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:45.306287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:45.306257 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:50.917329 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:50.917292 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:50.977472 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:50.977438 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:51.059388 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:51.059344 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:51.157534 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:30:51.157499 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:00.012520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:00.012484 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl"] Jul 02 19:31:00.012964 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:00.012675 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" podUID="592707b5-e781-486a-9b2d-dcb0a5b1249f" containerName="cleanup" containerID="cri-o://e0b7912798ea971dae128ceed5ff77aba8e21540046d2c7e9b1969802d77cac5" gracePeriod=30 Jul 02 19:31:07.001490 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:07.001450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:11.974329 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:11.974289 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:12.039648 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:12.039611 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:12.950500 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:12.950470 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:13.056416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:13.056380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:13.151772 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:13.151741 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:23.675796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:23.675740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:24.511262 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:24.511230 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:30.177941 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.177906 2582 generic.go:356] "Generic (PLEG): container finished" podID="592707b5-e781-486a-9b2d-dcb0a5b1249f" containerID="e0b7912798ea971dae128ceed5ff77aba8e21540046d2c7e9b1969802d77cac5" exitCode=137 Jul 02 19:31:30.178332 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.177979 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" event={"ID":"592707b5-e781-486a-9b2d-dcb0a5b1249f","Type":"ContainerDied","Data":"e0b7912798ea971dae128ceed5ff77aba8e21540046d2c7e9b1969802d77cac5"} Jul 02 19:31:30.207826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.207776 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:31:30.227064 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.227028 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppqqx\" (UniqueName: \"kubernetes.io/projected/592707b5-e781-486a-9b2d-dcb0a5b1249f-kube-api-access-ppqqx\") pod \"592707b5-e781-486a-9b2d-dcb0a5b1249f\" (UID: \"592707b5-e781-486a-9b2d-dcb0a5b1249f\") " Jul 02 19:31:30.229914 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.229881 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592707b5-e781-486a-9b2d-dcb0a5b1249f-kube-api-access-ppqqx" (OuterVolumeSpecName: "kube-api-access-ppqqx") pod "592707b5-e781-486a-9b2d-dcb0a5b1249f" (UID: "592707b5-e781-486a-9b2d-dcb0a5b1249f"). InnerVolumeSpecName "kube-api-access-ppqqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:31:30.328577 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.328542 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppqqx\" (UniqueName: \"kubernetes.io/projected/592707b5-e781-486a-9b2d-dcb0a5b1249f-kube-api-access-ppqqx\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:31:30.558491 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.558453 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:30.667500 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.667415 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:30.758674 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.758641 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:30.858018 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:30.857984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:31.184949 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.184916 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" event={"ID":"592707b5-e781-486a-9b2d-dcb0a5b1249f","Type":"ContainerDied","Data":"7132da02b2d02315e1caa43e359948e343779400ce3b0e94400bc2cb1ceee394"} Jul 02 19:31:31.184949 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.184938 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl" Jul 02 19:31:31.185447 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.184980 2582 scope.go:117] "RemoveContainer" containerID="e0b7912798ea971dae128ceed5ff77aba8e21540046d2c7e9b1969802d77cac5" Jul 02 19:31:31.220456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.220420 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl"] Jul 02 19:31:31.235417 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.235379 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717010-528xl"] Jul 02 19:31:31.652529 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.652479 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:31.744047 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.744007 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:31.849702 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:31.849667 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:32.072124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:32.072092 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592707b5-e781-486a-9b2d-dcb0a5b1249f" path="/var/lib/kubelet/pods/592707b5-e781-486a-9b2d-dcb0a5b1249f/volumes" Jul 02 19:31:33.535688 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:33.535651 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:39.456936 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:39.456891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:39.523361 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:39.523321 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:40.150487 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:40.150439 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:45.855494 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:45.855449 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:45.920397 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:45.920366 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:46.096983 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:46.096947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:46.526918 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:46.526882 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:46.598335 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:46.598304 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:49.958091 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:49.958048 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:50.034188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:50.034149 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:50.114209 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:50.114174 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:50.543680 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:50.543633 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:50.646980 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:50.646944 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:50.744821 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:50.744756 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:54.450456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:54.450419 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:55.130847 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:55.130776 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:55.231408 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:55.231379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:55.603461 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:31:55.603422 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:01.275620 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:01.275585 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:01.344168 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:01.344133 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:01.839962 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:01.839930 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:02.185533 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:02.185430 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:02.247269 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:02.247235 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:08.330417 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:08.330379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:08.434656 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:08.434616 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:08.598546 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:08.598455 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:08.929084 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:08.928995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:09.033201 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:09.033168 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:09.209930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:09.209846 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:15.120854 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:15.120825 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:15.228772 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:15.228732 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:15.321842 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:15.321806 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:15.484169 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:15.484091 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:21.618772 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:21.618733 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:21.726599 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:21.726566 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:28.112660 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:28.112617 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:28.425001 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:28.424912 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:29.275414 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:29.275369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:31.238936 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:31.238898 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:31.355632 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:31.355595 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:31.461341 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:31.461309 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:31.698471 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:31.698435 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:31.814078 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:31.814049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:31.918686 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:31.918656 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:35.704287 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:35.704176 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:47.799028 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:47.798997 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:49.978018 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:49.977985 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:52.763525 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:52.763491 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:52.864802 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:32:52.864745 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:13.221823 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:13.221770 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:13.587626 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:13.587591 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:19.235990 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:19.235956 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:24.309815 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:24.309702 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:28.123664 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:28.123632 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:33:28.127985 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:28.127957 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:33:28.132472 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:28.132451 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:33:28.136043 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:33:28.136024 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:34:00.392121 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:00.392080 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:01.160767 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:01.160734 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:06.757284 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:06.757250 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:06.858818 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:06.858769 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:07.030852 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:07.030742 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:08.389225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:08.389191 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:08.487037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:08.486996 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:08.585653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:08.585619 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:09.283364 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:09.283254 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:09.374514 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:09.374483 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:09.482794 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:09.482750 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:10.827936 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:10.827895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:16.821024 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:16.820991 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:16.921529 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:16.921499 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:17.549278 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:17.549242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:23.268047 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:23.268005 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:23.382434 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:23.382389 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:23.473859 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:23.473813 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:23.697915 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:23.697887 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:34.062454 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:34.062410 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:34.378148 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:34.378052 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:55.335915 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:34:55.335794 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:01.332138 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:01.332104 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:01.512796 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:01.512749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:01.666557 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:01.666470 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:01.975700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:01.975603 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:02.077706 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:02.077675 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:04.892001 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:04.891966 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:04.980577 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:04.980545 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:05.148520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:05.148435 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:05.701757 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:05.701724 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:05.802675 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:05.802642 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:05.902343 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:05.902311 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:09.380394 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:09.380362 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:09.723453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:09.723368 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:10.060676 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:10.060643 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:10.955928 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:10.955891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:12.941478 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:12.941441 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:13.022322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:13.022290 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:13.096832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:13.096769 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:13.403869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:13.403838 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:13.656475 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:13.656383 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:13.757190 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:13.757155 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:17.502292 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:17.502253 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:26.604426 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:26.604388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:26.708629 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:26.708585 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:34.405727 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:34.405693 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:34.511731 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:34.511699 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:36.556394 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:36.556363 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:46.292435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:35:46.292400 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:06.946142 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946103 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz"] Jul 02 19:36:06.946611 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946595 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerName="cleanup" Jul 02 19:36:06.946663 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946613 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerName="cleanup" Jul 02 19:36:06.946663 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946623 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592707b5-e781-486a-9b2d-dcb0a5b1249f" containerName="cleanup" Jul 02 19:36:06.946663 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946628 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="592707b5-e781-486a-9b2d-dcb0a5b1249f" containerName="cleanup" Jul 02 19:36:06.946769 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946699 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerName="cleanup" Jul 02 19:36:06.946769 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946712 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="592707b5-e781-486a-9b2d-dcb0a5b1249f" containerName="cleanup" Jul 02 19:36:06.946769 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.946738 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerName="cleanup" Jul 02 19:36:06.949804 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.949757 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:06.953017 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.952995 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-78744c\"/\"default-dockercfg-9fb44\"" Jul 02 19:36:06.953124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.953014 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-78744c\"/\"openshift-service-ca.crt\"" Jul 02 19:36:06.954209 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.954186 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-78744c\"/\"kube-root-ca.crt\"" Jul 02 19:36:06.954304 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.954222 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-78744c\"/\"test-model-78744c-kserve-self-signed-certs\"" Jul 02 19:36:06.960978 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.960959 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz"] Jul 02 19:36:06.987520 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:06.987487 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:07.005674 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.005648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tmp-dir\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.005826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.005678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5brfn\" (UniqueName: \"kubernetes.io/projected/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-kube-api-access-5brfn\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.005826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.005726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-home\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.005826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.005748 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-dshm\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.005826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.005801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-model-cache\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.005826 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.005817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tls-certs\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.106628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.106584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tmp-dir\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.106628 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.106632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5brfn\" (UniqueName: \"kubernetes.io/projected/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-kube-api-access-5brfn\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.106930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.106712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-home\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.106930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.106749 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-dshm\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.106930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.106824 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-model-cache\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.106930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.106848 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tls-certs\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.107285 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.107260 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-model-cache\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.107876 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.107842 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tmp-dir\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.108018 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.107872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-home\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.110739 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.110718 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-dshm\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.111042 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.111022 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tls-certs\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.119203 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.119178 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5brfn\" (UniqueName: \"kubernetes.io/projected/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-kube-api-access-5brfn\") pod \"test-model-78744c-kserve-64868c475-zvgnz\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.260037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.259949 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:07.604901 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.604870 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz"] Jul 02 19:36:07.606550 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:36:07.606525 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fcd983b_5a0d_4fec_9791_bb8afb3d41be.slice/crio-d2256f8cbb0f99067811e3b1d09ddfaa41a8cfdfabd357b7be3daafb74547c32 WatchSource:0}: Error finding container d2256f8cbb0f99067811e3b1d09ddfaa41a8cfdfabd357b7be3daafb74547c32: Status 404 returned error can't find the container with id d2256f8cbb0f99067811e3b1d09ddfaa41a8cfdfabd357b7be3daafb74547c32 Jul 02 19:36:07.741726 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.741686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" event={"ID":"5fcd983b-5a0d-4fec-9791-bb8afb3d41be","Type":"ContainerStarted","Data":"4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6"} Jul 02 19:36:07.741916 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.741739 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" event={"ID":"5fcd983b-5a0d-4fec-9791-bb8afb3d41be","Type":"ContainerStarted","Data":"d2256f8cbb0f99067811e3b1d09ddfaa41a8cfdfabd357b7be3daafb74547c32"} Jul 02 19:36:07.764942 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:07.764890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" podStartSLOduration=1.764875612 podStartE2EDuration="1.764875612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:36:07.762604354 +0000 UTC m=+1960.298361854" watchObservedRunningTime="2026-07-02 19:36:07.764875612 +0000 UTC m=+1960.300633116" Jul 02 19:36:17.260360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:17.260323 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:17.260738 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:17.260379 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:17.272767 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:17.272737 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:17.811526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:17.811494 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:31.547224 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:31.547136 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:32.426581 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:32.426551 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz"] Jul 02 19:36:32.447943 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:32.447900 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:32.689558 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:32.689459 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:33.147448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:33.147415 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:33.257703 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:33.257670 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:33.355746 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:33.355707 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:33.505590 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:33.505497 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:38.206400 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:38.206363 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:43.968695 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:43.968659 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:47.447437 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.447373 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" podUID="5fcd983b-5a0d-4fec-9791-bb8afb3d41be" containerName="main" containerID="cri-o://4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6" gracePeriod=45 Jul 02 19:36:47.706051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.705990 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:47.788331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788294 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-model-cache\") pod \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " Jul 02 19:36:47.788533 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788368 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-home\") pod \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " Jul 02 19:36:47.788533 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788391 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tls-certs\") pod \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " Jul 02 19:36:47.788533 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788442 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tmp-dir\") pod \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " Jul 02 19:36:47.788700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788604 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5brfn\" (UniqueName: \"kubernetes.io/projected/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-kube-api-access-5brfn\") pod \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " Jul 02 19:36:47.788700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788623 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-model-cache" (OuterVolumeSpecName: "model-cache") pod "5fcd983b-5a0d-4fec-9791-bb8afb3d41be" (UID: "5fcd983b-5a0d-4fec-9791-bb8afb3d41be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:36:47.788700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788648 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-home" (OuterVolumeSpecName: "home") pod "5fcd983b-5a0d-4fec-9791-bb8afb3d41be" (UID: "5fcd983b-5a0d-4fec-9791-bb8afb3d41be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:36:47.788700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788651 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-dshm\") pod \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\" (UID: \"5fcd983b-5a0d-4fec-9791-bb8afb3d41be\") " Jul 02 19:36:47.788700 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.788682 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5fcd983b-5a0d-4fec-9791-bb8afb3d41be" (UID: "5fcd983b-5a0d-4fec-9791-bb8afb3d41be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:36:47.789054 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.789021 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-model-cache\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:36:47.789054 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.789047 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-home\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:36:47.789187 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.789061 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tmp-dir\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:36:47.790762 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.790737 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-kube-api-access-5brfn" (OuterVolumeSpecName: "kube-api-access-5brfn") pod "5fcd983b-5a0d-4fec-9791-bb8afb3d41be" (UID: "5fcd983b-5a0d-4fec-9791-bb8afb3d41be"). InnerVolumeSpecName "kube-api-access-5brfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:36:47.790762 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.790749 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5fcd983b-5a0d-4fec-9791-bb8afb3d41be" (UID: "5fcd983b-5a0d-4fec-9791-bb8afb3d41be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:36:47.791004 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.790824 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-dshm" (OuterVolumeSpecName: "dshm") pod "5fcd983b-5a0d-4fec-9791-bb8afb3d41be" (UID: "5fcd983b-5a0d-4fec-9791-bb8afb3d41be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:36:47.889930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.889893 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-tls-certs\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:36:47.889930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.889925 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5brfn\" (UniqueName: \"kubernetes.io/projected/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-kube-api-access-5brfn\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:36:47.889930 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.889934 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fcd983b-5a0d-4fec-9791-bb8afb3d41be-dshm\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:36:47.972127 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.972035 2582 generic.go:356] "Generic (PLEG): container finished" podID="5fcd983b-5a0d-4fec-9791-bb8afb3d41be" containerID="4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6" exitCode=0 Jul 02 19:36:47.972127 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.972080 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" Jul 02 19:36:47.972368 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.972128 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" event={"ID":"5fcd983b-5a0d-4fec-9791-bb8afb3d41be","Type":"ContainerDied","Data":"4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6"} Jul 02 19:36:47.972368 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.972173 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz" event={"ID":"5fcd983b-5a0d-4fec-9791-bb8afb3d41be","Type":"ContainerDied","Data":"d2256f8cbb0f99067811e3b1d09ddfaa41a8cfdfabd357b7be3daafb74547c32"} Jul 02 19:36:47.972368 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.972198 2582 scope.go:117] "RemoveContainer" containerID="4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6" Jul 02 19:36:47.982038 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.982015 2582 scope.go:117] "RemoveContainer" containerID="4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6" Jul 02 19:36:47.982369 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:36:47.982343 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6\": container with ID starting with 4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6 not found: ID does not exist" containerID="4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6" Jul 02 19:36:47.982453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.982376 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6"} err="failed to get container status \"4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6\": rpc error: code = NotFound desc = could not find container \"4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6\": container with ID starting with 4abda706a559e116a0a288e723a5c07b80131a2c85ec9a1fd3b3bdf6baaa0aa6 not found: ID does not exist" Jul 02 19:36:47.995051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.995025 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz"] Jul 02 19:36:47.999538 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:47.999507 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-78744c/test-model-78744c-kserve-64868c475-zvgnz"] Jul 02 19:36:48.073497 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:36:48.073462 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fcd983b-5a0d-4fec-9791-bb8afb3d41be" path="/var/lib/kubelet/pods/5fcd983b-5a0d-4fec-9791-bb8afb3d41be/volumes" Jul 02 19:37:15.175189 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:15.175151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:15.454369 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:15.454282 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:15.913723 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:15.913689 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:16.335148 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:16.335111 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:16.444945 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:16.444912 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:16.599190 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:16.599107 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:22.026395 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:22.026356 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:22.092312 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:22.092278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:22.299313 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:22.299283 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:22.882040 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:22.882000 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:23.211702 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:23.211613 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:23.550817 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:23.550759 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:26.669465 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:26.669426 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:26.793573 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:26.793537 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:26.913820 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:26.913774 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.011534 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:27.011446 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.397711 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:27.397674 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.498072 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:27.498042 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:31.128496 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:31.128460 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:31.607176 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:31.607134 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:31.975309 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:31.975217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:32.207717 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:32.207678 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:34.786351 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.786306 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:34.898618 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.898580 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp"] Jul 02 19:37:34.899030 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.899014 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcd983b-5a0d-4fec-9791-bb8afb3d41be" containerName="main" Jul 02 19:37:34.899085 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.899032 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcd983b-5a0d-4fec-9791-bb8afb3d41be" containerName="main" Jul 02 19:37:34.899085 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.899051 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerName="cleanup" Jul 02 19:37:34.899085 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.899057 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7cf929-36ff-4733-9fe4-68c28fdaab33" containerName="cleanup" Jul 02 19:37:34.899189 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.899119 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fcd983b-5a0d-4fec-9791-bb8afb3d41be" containerName="main" Jul 02 19:37:34.902590 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.902568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:34.906764 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.906739 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 02 19:37:34.906910 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.906854 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4be470-serving-cert\"" Jul 02 19:37:34.907080 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.907067 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 02 19:37:34.907683 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.907665 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g6bdc\"" Jul 02 19:37:34.928315 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.928290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp"] Jul 02 19:37:34.950085 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:34.950063 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:35.024124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.024087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.024286 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.024148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb84e1aa-7739-4817-bba2-f80dbac672e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.024286 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.024250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djw8n\" (UniqueName: \"kubernetes.io/projected/bb84e1aa-7739-4817-bba2-f80dbac672e3-kube-api-access-djw8n\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.077452 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.077417 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:35.125079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.125043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djw8n\" (UniqueName: \"kubernetes.io/projected/bb84e1aa-7739-4817-bba2-f80dbac672e3-kube-api-access-djw8n\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.125253 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.125131 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.125253 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.125170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb84e1aa-7739-4817-bba2-f80dbac672e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.125384 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:37:35.125279 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-serving-cert: secret "maas-api-e2e-api-b-4be470-serving-cert" not found Jul 02 19:37:35.125384 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:37:35.125355 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls podName:bb84e1aa-7739-4817-bba2-f80dbac672e3 nodeName:}" failed. No retries permitted until 2026-07-02 19:37:35.625333794 +0000 UTC m=+2048.161091273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls") pod "maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" (UID: "bb84e1aa-7739-4817-bba2-f80dbac672e3") : secret "maas-api-e2e-api-b-4be470-serving-cert" not found Jul 02 19:37:35.125756 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.125735 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb84e1aa-7739-4817-bba2-f80dbac672e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.143173 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.143139 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djw8n\" (UniqueName: \"kubernetes.io/projected/bb84e1aa-7739-4817-bba2-f80dbac672e3-kube-api-access-djw8n\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.489193 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.489108 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:35.630873 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.630828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.633224 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.633204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4be470-f9f48d568-nw6vp\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.662012 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.661985 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:35.764869 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.764690 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:35.813062 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.813032 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:35.986714 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:37:35.986686 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb84e1aa_7739_4817_bba2_f80dbac672e3.slice/crio-b6e06bbe999573914ce30e17a33f465e71e24dfbd9d2153f78fd4d2f7f686a03 WatchSource:0}: Error finding container b6e06bbe999573914ce30e17a33f465e71e24dfbd9d2153f78fd4d2f7f686a03: Status 404 returned error can't find the container with id b6e06bbe999573914ce30e17a33f465e71e24dfbd9d2153f78fd4d2f7f686a03 Jul 02 19:37:35.987716 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.987694 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp"] Jul 02 19:37:35.988145 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:35.988130 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:37:36.243443 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:36.243411 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" event={"ID":"bb84e1aa-7739-4817-bba2-f80dbac672e3","Type":"ContainerStarted","Data":"b6e06bbe999573914ce30e17a33f465e71e24dfbd9d2153f78fd4d2f7f686a03"} Jul 02 19:37:38.256828 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:38.256773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" event={"ID":"bb84e1aa-7739-4817-bba2-f80dbac672e3","Type":"ContainerStarted","Data":"5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3"} Jul 02 19:37:38.257202 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:38.256849 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:39.185293 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:39.185244 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:44.268435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:44.268401 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:44.288837 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:44.288763 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" podStartSLOduration=8.862433228 podStartE2EDuration="10.28874951s" totalImagesPullingTime="1.426316282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:38.282848211 +0000 UTC m=+2050.818605724" watchObservedRunningTime="2026-07-02 19:37:44.28874951 +0000 UTC m=+2056.824507011" Jul 02 19:37:47.435544 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:47.435507 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:47.830172 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:47.830138 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:47.970051 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:47.970021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:48.071255 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:48.071221 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:48.230128 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:48.230046 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:49.968965 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:49.968918 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:51.337120 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:51.337085 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:53.587768 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:53.587731 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:53.688708 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:53.688669 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:53.818820 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:53.818767 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:54.462359 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:54.462322 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:54.816697 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:54.816659 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:54.913170 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:54.913134 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:55.016086 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.016054 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:55.082425 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.082338 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp"] Jul 02 19:37:55.082897 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.082853 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" podUID="bb84e1aa-7739-4817-bba2-f80dbac672e3" containerName="maas-api" containerID="cri-o://5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3" gracePeriod=30 Jul 02 19:37:55.112672 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.112647 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:55.337530 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.337463 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:55.357596 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.357555 2582 generic.go:356] "Generic (PLEG): container finished" podID="bb84e1aa-7739-4817-bba2-f80dbac672e3" containerID="5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3" exitCode=0 Jul 02 19:37:55.357752 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.357664 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" event={"ID":"bb84e1aa-7739-4817-bba2-f80dbac672e3","Type":"ContainerDied","Data":"5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3"} Jul 02 19:37:55.357752 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.357713 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" event={"ID":"bb84e1aa-7739-4817-bba2-f80dbac672e3","Type":"ContainerDied","Data":"b6e06bbe999573914ce30e17a33f465e71e24dfbd9d2153f78fd4d2f7f686a03"} Jul 02 19:37:55.357752 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.357743 2582 scope.go:117] "RemoveContainer" containerID="5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3" Jul 02 19:37:55.358011 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.357933 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp" Jul 02 19:37:55.367724 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.367703 2582 scope.go:117] "RemoveContainer" containerID="5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3" Jul 02 19:37:55.368054 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:37:55.368034 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3\": container with ID starting with 5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3 not found: ID does not exist" containerID="5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3" Jul 02 19:37:55.370235 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.368067 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3"} err="failed to get container status \"5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3\": rpc error: code = NotFound desc = could not find container \"5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3\": container with ID starting with 5b86b7b6fa9e2d6a85b45dde885e270a47becd437ffb728e863972c0bd0b25d3 not found: ID does not exist" Jul 02 19:37:55.427607 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.427574 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djw8n\" (UniqueName: \"kubernetes.io/projected/bb84e1aa-7739-4817-bba2-f80dbac672e3-kube-api-access-djw8n\") pod \"bb84e1aa-7739-4817-bba2-f80dbac672e3\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " Jul 02 19:37:55.427773 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.427704 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb84e1aa-7739-4817-bba2-f80dbac672e3-openshift-service-ca\") pod \"bb84e1aa-7739-4817-bba2-f80dbac672e3\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " Jul 02 19:37:55.427773 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.427759 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls\") pod \"bb84e1aa-7739-4817-bba2-f80dbac672e3\" (UID: \"bb84e1aa-7739-4817-bba2-f80dbac672e3\") " Jul 02 19:37:55.428127 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.428100 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb84e1aa-7739-4817-bba2-f80dbac672e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb84e1aa-7739-4817-bba2-f80dbac672e3" (UID: "bb84e1aa-7739-4817-bba2-f80dbac672e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:37:55.429753 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.429727 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb84e1aa-7739-4817-bba2-f80dbac672e3-kube-api-access-djw8n" (OuterVolumeSpecName: "kube-api-access-djw8n") pod "bb84e1aa-7739-4817-bba2-f80dbac672e3" (UID: "bb84e1aa-7739-4817-bba2-f80dbac672e3"). InnerVolumeSpecName "kube-api-access-djw8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:37:55.429857 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.429794 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb84e1aa-7739-4817-bba2-f80dbac672e3" (UID: "bb84e1aa-7739-4817-bba2-f80dbac672e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:37:55.528496 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.528461 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb84e1aa-7739-4817-bba2-f80dbac672e3-openshift-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:37:55.528496 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.528491 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb84e1aa-7739-4817-bba2-f80dbac672e3-maas-api-tls\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:37:55.528496 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.528502 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djw8n\" (UniqueName: \"kubernetes.io/projected/bb84e1aa-7739-4817-bba2-f80dbac672e3-kube-api-access-djw8n\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:37:55.682540 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.682501 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp"] Jul 02 19:37:55.686343 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:55.686315 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4be470-f9f48d568-nw6vp"] Jul 02 19:37:56.072444 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:37:56.072407 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb84e1aa-7739-4817-bba2-f80dbac672e3" path="/var/lib/kubelet/pods/bb84e1aa-7739-4817-bba2-f80dbac672e3/volumes" Jul 02 19:38:00.706303 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:00.706267 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:00.806832 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:00.806794 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:01.017619 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:01.017526 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:01.546404 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:01.546371 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:01.862882 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:01.862766 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:02.129435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:02.129353 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:04.712306 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.712271 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:04.860064 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.860034 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h"] Jul 02 19:38:04.860469 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.860455 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb84e1aa-7739-4817-bba2-f80dbac672e3" containerName="maas-api" Jul 02 19:38:04.860532 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.860473 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb84e1aa-7739-4817-bba2-f80dbac672e3" containerName="maas-api" Jul 02 19:38:04.860569 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.860558 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb84e1aa-7739-4817-bba2-f80dbac672e3" containerName="maas-api" Jul 02 19:38:04.863471 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.863442 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:04.863815 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.863802 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:04.867571 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.867551 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 02 19:38:04.868210 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.868193 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-74b95c-serving-cert\"" Jul 02 19:38:04.868574 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.868554 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g6bdc\"" Jul 02 19:38:04.868713 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.868695 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 02 19:38:04.886063 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.886038 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h"] Jul 02 19:38:04.907824 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.907770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3cab81-306a-4b70-9781-64d556a7b3d6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:04.907955 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.907853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdr9g\" (UniqueName: \"kubernetes.io/projected/bc3cab81-306a-4b70-9781-64d556a7b3d6-kube-api-access-vdr9g\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:04.907955 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:04.907891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3cab81-306a-4b70-9781-64d556a7b3d6-maas-api-tls\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.007225 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.007128 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:05.009346 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.009327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3cab81-306a-4b70-9781-64d556a7b3d6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.009417 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.009359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdr9g\" (UniqueName: \"kubernetes.io/projected/bc3cab81-306a-4b70-9781-64d556a7b3d6-kube-api-access-vdr9g\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.009417 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.009385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3cab81-306a-4b70-9781-64d556a7b3d6-maas-api-tls\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.010049 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.010026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3cab81-306a-4b70-9781-64d556a7b3d6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.011843 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.011822 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3cab81-306a-4b70-9781-64d556a7b3d6-maas-api-tls\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.018198 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.018174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdr9g\" (UniqueName: \"kubernetes.io/projected/bc3cab81-306a-4b70-9781-64d556a7b3d6-kube-api-access-vdr9g\") pod \"maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.126407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.126364 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:05.173418 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.173388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:05.328941 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.328911 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h"] Jul 02 19:38:05.332048 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:38:05.332022 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3cab81_306a_4b70_9781_64d556a7b3d6.slice/crio-feb092f1726e83e4994983d50e3c8a640c02489c55d320c1607047d64f98c6e1 WatchSource:0}: Error finding container feb092f1726e83e4994983d50e3c8a640c02489c55d320c1607047d64f98c6e1: Status 404 returned error can't find the container with id feb092f1726e83e4994983d50e3c8a640c02489c55d320c1607047d64f98c6e1 Jul 02 19:38:05.415476 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.415434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" event={"ID":"bc3cab81-306a-4b70-9781-64d556a7b3d6","Type":"ContainerStarted","Data":"feb092f1726e83e4994983d50e3c8a640c02489c55d320c1607047d64f98c6e1"} Jul 02 19:38:05.449766 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.449738 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:05.663439 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:05.663403 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:06.422685 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:06.422646 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" event={"ID":"bc3cab81-306a-4b70-9781-64d556a7b3d6","Type":"ContainerStarted","Data":"5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635"} Jul 02 19:38:06.423167 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:06.422716 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:06.443296 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:06.443243 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" podStartSLOduration=1.970491278 podStartE2EDuration="2.443228443s" totalImagesPullingTime="472.737165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:06.441337842 +0000 UTC m=+2078.977095360" watchObservedRunningTime="2026-07-02 19:38:06.443228443 +0000 UTC m=+2078.978985943" Jul 02 19:38:09.295223 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:09.295175 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:09.617443 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:09.617338 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:09.958848 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:09.958740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:10.055575 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:10.055538 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:12.433880 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:12.433846 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:38:12.953189 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:12.953155 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.101421 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.101388 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk"] Jul 02 19:38:13.105907 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.105869 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.109654 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.109635 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8e566a-serving-cert\"" Jul 02 19:38:13.129606 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.129583 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk"] Jul 02 19:38:13.183560 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.183533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4bdc\" (UniqueName: \"kubernetes.io/projected/4b1021f5-34f5-4686-b173-e69b1002bf38-kube-api-access-r4bdc\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.183721 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.183612 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.183721 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.183639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1021f5-34f5-4686-b173-e69b1002bf38-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.213662 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.213593 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.285124 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.285086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4bdc\" (UniqueName: \"kubernetes.io/projected/4b1021f5-34f5-4686-b173-e69b1002bf38-kube-api-access-r4bdc\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.285282 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.285201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.285282 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.285233 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1021f5-34f5-4686-b173-e69b1002bf38-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.285387 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:38:13.285367 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-serving-cert: secret "maas-api-e2e-shared-b-8e566a-serving-cert" not found Jul 02 19:38:13.285455 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:38:13.285444 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls podName:4b1021f5-34f5-4686-b173-e69b1002bf38 nodeName:}" failed. No retries permitted until 2026-07-02 19:38:13.785421422 +0000 UTC m=+2086.321178902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls") pod "maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" (UID: "4b1021f5-34f5-4686-b173-e69b1002bf38") : secret "maas-api-e2e-shared-b-8e566a-serving-cert" not found Jul 02 19:38:13.285994 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.285977 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1021f5-34f5-4686-b173-e69b1002bf38-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.302319 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.302291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4bdc\" (UniqueName: \"kubernetes.io/projected/4b1021f5-34f5-4686-b173-e69b1002bf38-kube-api-access-r4bdc\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.380231 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.380202 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.790212 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.790174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:13.790639 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:38:13.790327 2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-serving-cert: secret "maas-api-e2e-shared-b-8e566a-serving-cert" not found Jul 02 19:38:13.790639 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:38:13.790394 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls podName:4b1021f5-34f5-4686-b173-e69b1002bf38 nodeName:}" failed. No retries permitted until 2026-07-02 19:38:14.790379064 +0000 UTC m=+2087.326136543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls") pod "maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" (UID: "4b1021f5-34f5-4686-b173-e69b1002bf38") : secret "maas-api-e2e-shared-b-8e566a-serving-cert" not found Jul 02 19:38:13.876239 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.876212 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.973367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:13.973328 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:14.800683 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:14.800638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:14.803200 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:14.803166 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") pod \"maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:14.916535 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:14.916490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:15.053833 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:15.053797 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk"] Jul 02 19:38:15.054664 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:38:15.054637 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1021f5_34f5_4686_b173_e69b1002bf38.slice/crio-fa2b5d7f1db125e3afad6bc4e1a98e6eea8741716cb87018ac5a099c25650b4f WatchSource:0}: Error finding container fa2b5d7f1db125e3afad6bc4e1a98e6eea8741716cb87018ac5a099c25650b4f: Status 404 returned error can't find the container with id fa2b5d7f1db125e3afad6bc4e1a98e6eea8741716cb87018ac5a099c25650b4f Jul 02 19:38:15.474274 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:15.474244 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" event={"ID":"4b1021f5-34f5-4686-b173-e69b1002bf38","Type":"ContainerStarted","Data":"c9aceb47a7a799373292aa62fd3ff88e62995791e88735cc814627b228f90156"} Jul 02 19:38:15.474375 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:15.474300 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" event={"ID":"4b1021f5-34f5-4686-b173-e69b1002bf38","Type":"ContainerStarted","Data":"fa2b5d7f1db125e3afad6bc4e1a98e6eea8741716cb87018ac5a099c25650b4f"} Jul 02 19:38:15.474463 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:15.474446 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:15.493181 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:15.493136 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" podStartSLOduration=2.146899582 podStartE2EDuration="2.493119813s" totalImagesPullingTime="346.220231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:15.491152104 +0000 UTC m=+2088.026909626" watchObservedRunningTime="2026-07-02 19:38:15.493119813 +0000 UTC m=+2088.028877341" Jul 02 19:38:17.362180 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:17.362147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:21.486902 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:21.486867 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:38:26.431845 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:26.431807 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:26.519835 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:26.519772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:28.163764 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:28.163739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:38:28.167439 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:28.167418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:38:28.173023 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:28.173003 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:38:28.176441 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:28.176422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:38:32.401775 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:32.401714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:34.593396 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:34.593337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:34.697195 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:34.697147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:51.900055 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:38:51.900012 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:39:03.806086 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:39:03.806032 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:40:46.980204 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:46.980153 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:40:47.846344 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:47.846305 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:40:57.344248 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.344214 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj"] Jul 02 19:40:57.347792 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.347765 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.350675 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.350653 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"openshift-service-ca.crt\"" Jul 02 19:40:57.351694 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.351673 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"default-dockercfg-9f427\"" Jul 02 19:40:57.351807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.351694 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"sub-test-model-74b95c-kserve-self-signed-certs\"" Jul 02 19:40:57.351807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.351709 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"kube-root-ca.crt\"" Jul 02 19:40:57.357840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.357818 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj"] Jul 02 19:40:57.368160 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.368129 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:40:57.455262 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.455225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdkfr\" (UniqueName: \"kubernetes.io/projected/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-kube-api-access-sdkfr\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.455453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.455275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-home\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.455453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.455330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-model-cache\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.455453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.455417 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tls-certs\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.455591 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.455486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tmp-dir\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.455591 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.455555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-dshm\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557056 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557019 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-model-cache\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tls-certs\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tmp-dir\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-dshm\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdkfr\" (UniqueName: \"kubernetes.io/projected/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-kube-api-access-sdkfr\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557261 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-home\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557571 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557430 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-model-cache\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557571 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tmp-dir\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.557571 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.557562 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-home\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.559443 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.559416 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-dshm\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.559691 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.559673 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tls-certs\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.565982 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.565960 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdkfr\" (UniqueName: \"kubernetes.io/projected/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-kube-api-access-sdkfr\") pod \"sub-test-model-74b95c-kserve-7c5fc987f-q6cnj\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.658258 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.658160 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:40:57.801496 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:57.801469 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj"] Jul 02 19:40:57.803684 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:40:57.803657 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c6fc15e_ad7e_4997_b019_7a8101e99a4b.slice/crio-131f00a6ede7ff1374a5b21456a96530f9de70db7dd8f718b86d2673bf17eaeb WatchSource:0}: Error finding container 131f00a6ede7ff1374a5b21456a96530f9de70db7dd8f718b86d2673bf17eaeb: Status 404 returned error can't find the container with id 131f00a6ede7ff1374a5b21456a96530f9de70db7dd8f718b86d2673bf17eaeb Jul 02 19:40:58.421442 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:58.421410 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" event={"ID":"8c6fc15e-ad7e-4997-b019-7a8101e99a4b","Type":"ContainerStarted","Data":"e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19"} Jul 02 19:40:58.421442 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:58.421450 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" event={"ID":"8c6fc15e-ad7e-4997-b019-7a8101e99a4b","Type":"ContainerStarted","Data":"131f00a6ede7ff1374a5b21456a96530f9de70db7dd8f718b86d2673bf17eaeb"} Jul 02 19:40:58.439794 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:58.439738 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" podStartSLOduration=1.439723004 podStartE2EDuration="1.439723004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:40:58.437346592 +0000 UTC m=+2250.973104105" watchObservedRunningTime="2026-07-02 19:40:58.439723004 +0000 UTC m=+2250.975480506" Jul 02 19:40:58.883095 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:40:58.883058 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:41:07.658392 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:07.658351 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:41:07.658861 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:07.658412 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:41:07.670771 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:07.670744 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:41:08.501214 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:08.501184 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:41:15.256621 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:15.256586 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:41:53.199103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:53.199066 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj"] Jul 02 19:41:53.214215 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:53.214164 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:41:54.175435 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:41:54.175401 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:08.220149 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.220097 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" podUID="8c6fc15e-ad7e-4997-b019-7a8101e99a4b" containerName="main" containerID="cri-o://e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19" gracePeriod=45 Jul 02 19:42:08.473839 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.473763 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:42:08.553716 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.553677 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tmp-dir\") pod \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " Jul 02 19:42:08.553716 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.553725 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdkfr\" (UniqueName: \"kubernetes.io/projected/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-kube-api-access-sdkfr\") pod \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " Jul 02 19:42:08.554015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.553743 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-home\") pod \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " Jul 02 19:42:08.554015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.553830 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-dshm\") pod \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " Jul 02 19:42:08.554015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.553850 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-model-cache\") pod \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " Jul 02 19:42:08.554015 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.553881 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tls-certs\") pod \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\" (UID: \"8c6fc15e-ad7e-4997-b019-7a8101e99a4b\") " Jul 02 19:42:08.554222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.554043 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c6fc15e-ad7e-4997-b019-7a8101e99a4b" (UID: "8c6fc15e-ad7e-4997-b019-7a8101e99a4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:42:08.554222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.554121 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-home" (OuterVolumeSpecName: "home") pod "8c6fc15e-ad7e-4997-b019-7a8101e99a4b" (UID: "8c6fc15e-ad7e-4997-b019-7a8101e99a4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:42:08.554222 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.554131 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c6fc15e-ad7e-4997-b019-7a8101e99a4b" (UID: "8c6fc15e-ad7e-4997-b019-7a8101e99a4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:42:08.554331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.554249 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tmp-dir\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:42:08.554331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.554262 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-home\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:42:08.554331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.554271 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-model-cache\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:42:08.556248 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.556215 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-dshm" (OuterVolumeSpecName: "dshm") pod "8c6fc15e-ad7e-4997-b019-7a8101e99a4b" (UID: "8c6fc15e-ad7e-4997-b019-7a8101e99a4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:42:08.556361 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.556285 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c6fc15e-ad7e-4997-b019-7a8101e99a4b" (UID: "8c6fc15e-ad7e-4997-b019-7a8101e99a4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:42:08.556361 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.556306 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-kube-api-access-sdkfr" (OuterVolumeSpecName: "kube-api-access-sdkfr") pod "8c6fc15e-ad7e-4997-b019-7a8101e99a4b" (UID: "8c6fc15e-ad7e-4997-b019-7a8101e99a4b"). InnerVolumeSpecName "kube-api-access-sdkfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:42:08.655456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.655417 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-dshm\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:42:08.655456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.655453 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-tls-certs\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:42:08.655456 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.655465 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdkfr\" (UniqueName: \"kubernetes.io/projected/8c6fc15e-ad7e-4997-b019-7a8101e99a4b-kube-api-access-sdkfr\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:42:08.839283 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.839247 2582 generic.go:356] "Generic (PLEG): container finished" podID="8c6fc15e-ad7e-4997-b019-7a8101e99a4b" containerID="e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19" exitCode=0 Jul 02 19:42:08.839481 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.839296 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" Jul 02 19:42:08.839481 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.839336 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" event={"ID":"8c6fc15e-ad7e-4997-b019-7a8101e99a4b","Type":"ContainerDied","Data":"e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19"} Jul 02 19:42:08.839481 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.839385 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj" event={"ID":"8c6fc15e-ad7e-4997-b019-7a8101e99a4b","Type":"ContainerDied","Data":"131f00a6ede7ff1374a5b21456a96530f9de70db7dd8f718b86d2673bf17eaeb"} Jul 02 19:42:08.839481 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.839410 2582 scope.go:117] "RemoveContainer" containerID="e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19" Jul 02 19:42:08.849616 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.849598 2582 scope.go:117] "RemoveContainer" containerID="e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19" Jul 02 19:42:08.849880 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:42:08.849860 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19\": container with ID starting with e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19 not found: ID does not exist" containerID="e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19" Jul 02 19:42:08.849939 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.849887 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19"} err="failed to get container status \"e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19\": rpc error: code = NotFound desc = could not find container \"e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19\": container with ID starting with e58686048fa12a70834ab0d85aad5db9f6e82bf7f5c00816f4f7a424b3e5fd19 not found: ID does not exist" Jul 02 19:42:08.861639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.861608 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj"] Jul 02 19:42:08.865765 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:08.865741 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/sub-test-model-74b95c-kserve-7c5fc987f-q6cnj"] Jul 02 19:42:10.072331 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:10.072299 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c6fc15e-ad7e-4997-b019-7a8101e99a4b" path="/var/lib/kubelet/pods/8c6fc15e-ad7e-4997-b019-7a8101e99a4b/volumes" Jul 02 19:42:11.183653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:11.183602 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:50.803026 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:50.802987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:50.892497 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:42:50.892459 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:01.766336 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:01.766301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:27.147348 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:27.147305 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:27.249036 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:27.249002 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:28.203632 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:28.203606 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:43:28.207355 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:28.207331 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:43:28.213886 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:28.213867 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:43:28.217276 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:28.217259 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8b44h_500c3995-f510-4cc7-a9b0-ab7abf494118/ovn-acl-logging/0.log" Jul 02 19:43:35.386642 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:35.386598 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:35.505557 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:35.505520 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:41.101224 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:41.101186 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:42.207640 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:42.207607 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:43.307690 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:43.307657 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:43.754016 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:43.753937 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:43.847206 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:43.847177 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:43.948169 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:43.948130 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:44.007822 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.007726 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h"] Jul 02 19:43:44.008044 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.008014 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" podUID="bc3cab81-306a-4b70-9781-64d556a7b3d6" containerName="maas-api" containerID="cri-o://5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635" gracePeriod=30 Jul 02 19:43:44.032643 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.032618 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:44.253633 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.253607 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:43:44.368928 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.368897 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdr9g\" (UniqueName: \"kubernetes.io/projected/bc3cab81-306a-4b70-9781-64d556a7b3d6-kube-api-access-vdr9g\") pod \"bc3cab81-306a-4b70-9781-64d556a7b3d6\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " Jul 02 19:43:44.369320 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.368948 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3cab81-306a-4b70-9781-64d556a7b3d6-openshift-service-ca\") pod \"bc3cab81-306a-4b70-9781-64d556a7b3d6\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " Jul 02 19:43:44.369320 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.369045 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3cab81-306a-4b70-9781-64d556a7b3d6-maas-api-tls\") pod \"bc3cab81-306a-4b70-9781-64d556a7b3d6\" (UID: \"bc3cab81-306a-4b70-9781-64d556a7b3d6\") " Jul 02 19:43:44.369398 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.369372 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc3cab81-306a-4b70-9781-64d556a7b3d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc3cab81-306a-4b70-9781-64d556a7b3d6" (UID: "bc3cab81-306a-4b70-9781-64d556a7b3d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:43:44.371103 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.371083 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3cab81-306a-4b70-9781-64d556a7b3d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc3cab81-306a-4b70-9781-64d556a7b3d6" (UID: "bc3cab81-306a-4b70-9781-64d556a7b3d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:43:44.371212 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.371190 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3cab81-306a-4b70-9781-64d556a7b3d6-kube-api-access-vdr9g" (OuterVolumeSpecName: "kube-api-access-vdr9g") pod "bc3cab81-306a-4b70-9781-64d556a7b3d6" (UID: "bc3cab81-306a-4b70-9781-64d556a7b3d6"). InnerVolumeSpecName "kube-api-access-vdr9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:43:44.384263 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.384233 2582 generic.go:356] "Generic (PLEG): container finished" podID="bc3cab81-306a-4b70-9781-64d556a7b3d6" containerID="5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635" exitCode=0 Jul 02 19:43:44.384407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.384277 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" Jul 02 19:43:44.384407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.384308 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" event={"ID":"bc3cab81-306a-4b70-9781-64d556a7b3d6","Type":"ContainerDied","Data":"5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635"} Jul 02 19:43:44.384407 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.384380 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h" event={"ID":"bc3cab81-306a-4b70-9781-64d556a7b3d6","Type":"ContainerDied","Data":"feb092f1726e83e4994983d50e3c8a640c02489c55d320c1607047d64f98c6e1"} Jul 02 19:43:44.384582 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.384413 2582 scope.go:117] "RemoveContainer" containerID="5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635" Jul 02 19:43:44.394249 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.394229 2582 scope.go:117] "RemoveContainer" containerID="5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635" Jul 02 19:43:44.394486 ip-10-0-137-48 kubenswrapper[2582]: E0702 19:43:44.394466 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635\": container with ID starting with 5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635 not found: ID does not exist" containerID="5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635" Jul 02 19:43:44.394553 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.394496 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635"} err="failed to get container status \"5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635\": rpc error: code = NotFound desc = could not find container \"5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635\": container with ID starting with 5c36070741316943b57433a4a7ec3852eecdda824585a95f2aa9d14c73759635 not found: ID does not exist" Jul 02 19:43:44.424022 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.423996 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h"] Jul 02 19:43:44.438607 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.438584 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-74b95c-84fd9ddc54-5nq6h"] Jul 02 19:43:44.470079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.470048 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdr9g\" (UniqueName: \"kubernetes.io/projected/bc3cab81-306a-4b70-9781-64d556a7b3d6-kube-api-access-vdr9g\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:43:44.470079 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.470075 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3cab81-306a-4b70-9781-64d556a7b3d6-openshift-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:43:44.470231 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:44.470090 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3cab81-306a-4b70-9781-64d556a7b3d6-maas-api-tls\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:43:46.072153 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:46.072114 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3cab81-306a-4b70-9781-64d556a7b3d6" path="/var/lib/kubelet/pods/bc3cab81-306a-4b70-9781-64d556a7b3d6/volumes" Jul 02 19:43:48.809937 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:43:48.809904 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:10.136282 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:10.136245 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:26.116322 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:26.116287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:26.371212 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:26.371130 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:26.776308 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:26.776205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:27.172027 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.171993 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:27.272561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.272524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:27.373043 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.373006 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:27.420579 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.420545 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk"] Jul 02 19:44:27.420859 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.420797 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" podUID="4b1021f5-34f5-4686-b173-e69b1002bf38" containerName="maas-api" containerID="cri-o://c9aceb47a7a799373292aa62fd3ff88e62995791e88735cc814627b228f90156" gracePeriod=30 Jul 02 19:44:27.445297 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.445264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:27.638584 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.638551 2582 generic.go:356] "Generic (PLEG): container finished" podID="4b1021f5-34f5-4686-b173-e69b1002bf38" containerID="c9aceb47a7a799373292aa62fd3ff88e62995791e88735cc814627b228f90156" exitCode=0 Jul 02 19:44:27.638584 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.638578 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" event={"ID":"4b1021f5-34f5-4686-b173-e69b1002bf38","Type":"ContainerDied","Data":"c9aceb47a7a799373292aa62fd3ff88e62995791e88735cc814627b228f90156"} Jul 02 19:44:27.671614 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.671591 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:44:27.761339 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.761259 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4bdc\" (UniqueName: \"kubernetes.io/projected/4b1021f5-34f5-4686-b173-e69b1002bf38-kube-api-access-r4bdc\") pod \"4b1021f5-34f5-4686-b173-e69b1002bf38\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " Jul 02 19:44:27.761483 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.761347 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") pod \"4b1021f5-34f5-4686-b173-e69b1002bf38\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " Jul 02 19:44:27.761483 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.761414 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1021f5-34f5-4686-b173-e69b1002bf38-openshift-service-ca\") pod \"4b1021f5-34f5-4686-b173-e69b1002bf38\" (UID: \"4b1021f5-34f5-4686-b173-e69b1002bf38\") " Jul 02 19:44:27.761834 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.761772 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1021f5-34f5-4686-b173-e69b1002bf38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b1021f5-34f5-4686-b173-e69b1002bf38" (UID: "4b1021f5-34f5-4686-b173-e69b1002bf38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:44:27.763351 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.763322 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b1021f5-34f5-4686-b173-e69b1002bf38" (UID: "4b1021f5-34f5-4686-b173-e69b1002bf38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:44:27.763351 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.763327 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1021f5-34f5-4686-b173-e69b1002bf38-kube-api-access-r4bdc" (OuterVolumeSpecName: "kube-api-access-r4bdc") pod "4b1021f5-34f5-4686-b173-e69b1002bf38" (UID: "4b1021f5-34f5-4686-b173-e69b1002bf38"). InnerVolumeSpecName "kube-api-access-r4bdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:44:27.863032 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.862995 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1021f5-34f5-4686-b173-e69b1002bf38-openshift-service-ca\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:44:27.863032 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.863026 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4bdc\" (UniqueName: \"kubernetes.io/projected/4b1021f5-34f5-4686-b173-e69b1002bf38-kube-api-access-r4bdc\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:44:27.863032 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:27.863035 2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1021f5-34f5-4686-b173-e69b1002bf38-maas-api-tls\") on node \"ip-10-0-137-48.ec2.internal\" DevicePath \"\"" Jul 02 19:44:28.645438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:28.645408 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" Jul 02 19:44:28.645438 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:28.645413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk" event={"ID":"4b1021f5-34f5-4686-b173-e69b1002bf38","Type":"ContainerDied","Data":"fa2b5d7f1db125e3afad6bc4e1a98e6eea8741716cb87018ac5a099c25650b4f"} Jul 02 19:44:28.645963 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:28.645477 2582 scope.go:117] "RemoveContainer" containerID="c9aceb47a7a799373292aa62fd3ff88e62995791e88735cc814627b228f90156" Jul 02 19:44:28.665234 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:28.665212 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk"] Jul 02 19:44:28.669484 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:28.669464 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8e566a-74fb9f9874-kzzlk"] Jul 02 19:44:30.071989 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:30.071955 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1021f5-34f5-4686-b173-e69b1002bf38" path="/var/lib/kubelet/pods/4b1021f5-34f5-4686-b173-e69b1002bf38/volumes" Jul 02 19:44:33.261991 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:33.261960 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:33.333061 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:33.333015 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:33.551128 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:33.551095 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:36.744128 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:36.744093 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:38.770925 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:38.770877 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vfwdc_9e201540-5523-42ce-a836-f006a099b3cf/manager/0.log" Jul 02 19:44:38.888413 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:38.888374 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4w99m_f11a1588-d9b6-4416-8f55-4755ea04f373/manager/0.log" Jul 02 19:44:39.632088 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:39.632059 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-q54wr_addc6b05-edd0-4c01-9818-3403b8d5adda/copy-manifests/0.log" Jul 02 19:44:39.646279 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:39.646251 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-q54wr_addc6b05-edd0-4c01-9818-3403b8d5adda/manager/0.log" Jul 02 19:44:40.448206 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.448173 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p_4a518d23-2659-48d2-9e7b-5f81a537a99d/util/0.log" Jul 02 19:44:40.455624 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.455599 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p_4a518d23-2659-48d2-9e7b-5f81a537a99d/pull/0.log" Jul 02 19:44:40.462358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.462334 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p_4a518d23-2659-48d2-9e7b-5f81a537a99d/extract/0.log" Jul 02 19:44:40.575635 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.575610 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z_068c12e5-606d-4f74-b2f9-165a3a223df7/util/0.log" Jul 02 19:44:40.582566 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.582544 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z_068c12e5-606d-4f74-b2f9-165a3a223df7/pull/0.log" Jul 02 19:44:40.588958 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.588932 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z_068c12e5-606d-4f74-b2f9-165a3a223df7/extract/0.log" Jul 02 19:44:40.700945 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.700871 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6_3b17188d-ac54-443b-adf1-3e3a6dcf75cb/util/0.log" Jul 02 19:44:40.709275 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.709252 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6_3b17188d-ac54-443b-adf1-3e3a6dcf75cb/pull/0.log" Jul 02 19:44:40.715863 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.715822 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6_3b17188d-ac54-443b-adf1-3e3a6dcf75cb/extract/0.log" Jul 02 19:44:40.832845 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.832818 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r_2d783fcb-dd19-4a91-9967-be33d8003460/util/0.log" Jul 02 19:44:40.839772 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.839743 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r_2d783fcb-dd19-4a91-9967-be33d8003460/pull/0.log" Jul 02 19:44:40.847004 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:40.846985 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r_2d783fcb-dd19-4a91-9967-be33d8003460/extract/0.log" Jul 02 19:44:41.084486 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:41.084453 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m9g9m_b26e5773-ff7e-4c5c-a035-89f055f44d9e/manager/0.log" Jul 02 19:44:41.196091 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:41.196062 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lj58w_c61ad024-d5fe-4467-b372-afb51cb32b8a/manager/0.log" Jul 02 19:44:41.308358 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:41.308330 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qp47b_a7cf19eb-af20-4f9f-a025-5d4efb7879c5/kuadrant-console-plugin/0.log" Jul 02 19:44:41.425639 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:41.425565 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xj6cf_0b98fc31-2add-4bea-8a75-e96e242a3fb2/registry-server/0.log" Jul 02 19:44:41.550145 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:41.550113 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bs4dw_0f24d898-66ea-4715-a0e8-922ec72027fa/manager/0.log" Jul 02 19:44:42.724273 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:42.724246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jtxlz_d05e450c-0106-4da6-a1d5-f393d2e7dc7b/payload-pre-processing/0.log" Jul 02 19:44:42.957638 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:42.957610 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66b9b55d7-skxpt_b2780353-a8e5-4cdc-92b4-5db22295bc50/router/0.log" Jul 02 19:44:43.534777 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:43.534746 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zk8xq_3e521154-8a18-42b9-b416-3f9e931eea46/main/0.log" Jul 02 19:44:48.546063 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546016 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88s92/must-gather-nn8mp"] Jul 02 19:44:48.546633 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546613 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6fc15e-ad7e-4997-b019-7a8101e99a4b" containerName="main" Jul 02 19:44:48.546633 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546631 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6fc15e-ad7e-4997-b019-7a8101e99a4b" containerName="main" Jul 02 19:44:48.546708 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546646 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1021f5-34f5-4686-b173-e69b1002bf38" containerName="maas-api" Jul 02 19:44:48.546708 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546655 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1021f5-34f5-4686-b173-e69b1002bf38" containerName="maas-api" Jul 02 19:44:48.546708 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546673 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3cab81-306a-4b70-9781-64d556a7b3d6" containerName="maas-api" Jul 02 19:44:48.546708 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546683 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3cab81-306a-4b70-9781-64d556a7b3d6" containerName="maas-api" Jul 02 19:44:48.546874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546840 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3cab81-306a-4b70-9781-64d556a7b3d6" containerName="maas-api" Jul 02 19:44:48.546874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546853 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1021f5-34f5-4686-b173-e69b1002bf38" containerName="maas-api" Jul 02 19:44:48.546874 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.546865 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c6fc15e-ad7e-4997-b019-7a8101e99a4b" containerName="main" Jul 02 19:44:48.552198 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.552174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.554681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.554659 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88s92\"/\"kube-root-ca.crt\"" Jul 02 19:44:48.555681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.555657 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88s92\"/\"openshift-service-ca.crt\"" Jul 02 19:44:48.555995 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.555974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88s92\"/\"default-dockercfg-ll29f\"" Jul 02 19:44:48.559273 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.559250 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88s92/must-gather-nn8mp"] Jul 02 19:44:48.561462 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.561436 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:48.646615 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.646580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d15cf017-dd82-48a9-b880-a4bdc8852dc4-must-gather-output\") pod \"must-gather-nn8mp\" (UID: \"d15cf017-dd82-48a9-b880-a4bdc8852dc4\") " pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.646615 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.646624 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmt7r\" (UniqueName: \"kubernetes.io/projected/d15cf017-dd82-48a9-b880-a4bdc8852dc4-kube-api-access-dmt7r\") pod \"must-gather-nn8mp\" (UID: \"d15cf017-dd82-48a9-b880-a4bdc8852dc4\") " pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.661932 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.661900 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:48.747094 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.747054 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d15cf017-dd82-48a9-b880-a4bdc8852dc4-must-gather-output\") pod \"must-gather-nn8mp\" (UID: \"d15cf017-dd82-48a9-b880-a4bdc8852dc4\") " pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.747248 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.747104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmt7r\" (UniqueName: \"kubernetes.io/projected/d15cf017-dd82-48a9-b880-a4bdc8852dc4-kube-api-access-dmt7r\") pod \"must-gather-nn8mp\" (UID: \"d15cf017-dd82-48a9-b880-a4bdc8852dc4\") " pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.747416 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.747395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d15cf017-dd82-48a9-b880-a4bdc8852dc4-must-gather-output\") pod \"must-gather-nn8mp\" (UID: \"d15cf017-dd82-48a9-b880-a4bdc8852dc4\") " pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.755188 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.755157 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmt7r\" (UniqueName: \"kubernetes.io/projected/d15cf017-dd82-48a9-b880-a4bdc8852dc4-kube-api-access-dmt7r\") pod \"must-gather-nn8mp\" (UID: \"d15cf017-dd82-48a9-b880-a4bdc8852dc4\") " pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:48.863606 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:48.863510 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88s92/must-gather-nn8mp" Jul 02 19:44:49.009226 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:49.009194 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88s92/must-gather-nn8mp"] Jul 02 19:44:49.010733 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:44:49.010706 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd15cf017_dd82_48a9_b880_a4bdc8852dc4.slice/crio-e4c5f8879092b7b54b679e3316cdffdcf5367680b7223e8b760b370d5b145faa WatchSource:0}: Error finding container e4c5f8879092b7b54b679e3316cdffdcf5367680b7223e8b760b370d5b145faa: Status 404 returned error can't find the container with id e4c5f8879092b7b54b679e3316cdffdcf5367680b7223e8b760b370d5b145faa Jul 02 19:44:49.013184 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:49.013162 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:44:49.774424 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:49.774374 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/must-gather-nn8mp" event={"ID":"d15cf017-dd82-48a9-b880-a4bdc8852dc4","Type":"ContainerStarted","Data":"e4c5f8879092b7b54b679e3316cdffdcf5367680b7223e8b760b370d5b145faa"} Jul 02 19:44:50.785052 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:50.785008 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/must-gather-nn8mp" event={"ID":"d15cf017-dd82-48a9-b880-a4bdc8852dc4","Type":"ContainerStarted","Data":"5031dab878d05587cb4198224288c2ae262697aedf30bef9d3b466216aed51ab"} Jul 02 19:44:50.786570 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:50.786541 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/must-gather-nn8mp" event={"ID":"d15cf017-dd82-48a9-b880-a4bdc8852dc4","Type":"ContainerStarted","Data":"e72ab03d9c91faa932b6fd53f7ba9bb3ad7bed153c4cf0e3fb609f0d96a4aac0"} Jul 02 19:44:50.804445 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:50.804389 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88s92/must-gather-nn8mp" podStartSLOduration=1.974542387 podStartE2EDuration="2.80437351s" totalImagesPullingTime="829.831123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:44:50.803422989 +0000 UTC m=+2483.339180491" watchObservedRunningTime="2026-07-02 19:44:50.80437351 +0000 UTC m=+2483.340131053" Jul 02 19:44:51.529043 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:51.529003 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdbp6_2ed2587e-2a26-430f-9c12-42656f301bde/global-pull-secret-syncer/0.log" Jul 02 19:44:51.583614 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:51.583582 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2dmtd_6b1a1fca-fb70-4fb3-9be7-8d84fe2f06ee/konnectivity-agent/0.log" Jul 02 19:44:51.725162 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:51.725117 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-48.ec2.internal_44ccf5d2bec11f5aed6f9eee7ef6e2b0/haproxy/0.log" Jul 02 19:44:56.422907 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.422816 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p_4a518d23-2659-48d2-9e7b-5f81a537a99d/extract/0.log" Jul 02 19:44:56.456969 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.456884 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p_4a518d23-2659-48d2-9e7b-5f81a537a99d/util/0.log" Jul 02 19:44:56.480360 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.480271 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926n2p_4a518d23-2659-48d2-9e7b-5f81a537a99d/pull/0.log" Jul 02 19:44:56.510289 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.510202 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z_068c12e5-606d-4f74-b2f9-165a3a223df7/extract/0.log" Jul 02 19:44:56.536318 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.536246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z_068c12e5-606d-4f74-b2f9-165a3a223df7/util/0.log" Jul 02 19:44:56.559940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.559870 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lmz2z_068c12e5-606d-4f74-b2f9-165a3a223df7/pull/0.log" Jul 02 19:44:56.587994 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.587968 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6_3b17188d-ac54-443b-adf1-3e3a6dcf75cb/extract/0.log" Jul 02 19:44:56.617904 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.617801 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6_3b17188d-ac54-443b-adf1-3e3a6dcf75cb/util/0.log" Jul 02 19:44:56.642357 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.642323 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73575p6_3b17188d-ac54-443b-adf1-3e3a6dcf75cb/pull/0.log" Jul 02 19:44:56.675386 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.675248 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r_2d783fcb-dd19-4a91-9967-be33d8003460/extract/0.log" Jul 02 19:44:56.709426 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.709401 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r_2d783fcb-dd19-4a91-9967-be33d8003460/util/0.log" Jul 02 19:44:56.731519 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:56.731491 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p8v6r_2d783fcb-dd19-4a91-9967-be33d8003460/pull/0.log" Jul 02 19:44:57.026084 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:57.025999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m9g9m_b26e5773-ff7e-4c5c-a035-89f055f44d9e/manager/0.log" Jul 02 19:44:57.056555 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:57.056508 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lj58w_c61ad024-d5fe-4467-b372-afb51cb32b8a/manager/0.log" Jul 02 19:44:57.085110 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:57.085083 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qp47b_a7cf19eb-af20-4f9f-a025-5d4efb7879c5/kuadrant-console-plugin/0.log" Jul 02 19:44:57.130472 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:57.130439 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xj6cf_0b98fc31-2add-4bea-8a75-e96e242a3fb2/registry-server/0.log" Jul 02 19:44:57.281112 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:57.281026 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bs4dw_0f24d898-66ea-4715-a0e8-922ec72027fa/manager/0.log" Jul 02 19:44:59.369367 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.369339 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/alertmanager/0.log" Jul 02 19:44:59.404964 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.404918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/config-reloader/0.log" Jul 02 19:44:59.454196 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.454161 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/kube-rbac-proxy-web/0.log" Jul 02 19:44:59.484495 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.484452 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/kube-rbac-proxy/0.log" Jul 02 19:44:59.510009 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.509916 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/kube-rbac-proxy-metric/0.log" Jul 02 19:44:59.536387 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.536360 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/prom-label-proxy/0.log" Jul 02 19:44:59.562871 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.562825 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dfb69c2-a468-4992-b474-657e1f154757/init-config-reloader/0.log" Jul 02 19:44:59.611120 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.611083 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-dn2gj_833e3390-fa45-4e04-8918-28a52e92bf18/cluster-monitoring-operator/0.log" Jul 02 19:44:59.654633 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.654538 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-s5k66_c9bf7321-f371-4a1c-b842-bffeee1061d6/kube-state-metrics/0.log" Jul 02 19:44:59.683402 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.683368 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-s5k66_c9bf7321-f371-4a1c-b842-bffeee1061d6/kube-rbac-proxy-main/0.log" Jul 02 19:44:59.714058 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.714018 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-s5k66_c9bf7321-f371-4a1c-b842-bffeee1061d6/kube-rbac-proxy-self/0.log" Jul 02 19:44:59.822236 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.822156 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-27b8g_307b76c1-2e80-4ef7-8a46-3e6de9313048/node-exporter/0.log" Jul 02 19:44:59.847443 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.847405 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-27b8g_307b76c1-2e80-4ef7-8a46-3e6de9313048/kube-rbac-proxy/0.log" Jul 02 19:44:59.875210 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:44:59.875177 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-27b8g_307b76c1-2e80-4ef7-8a46-3e6de9313048/init-textfile/0.log" Jul 02 19:45:00.095737 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.095708 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4gmvm_c3e84b10-f7ac-4a83-8703-9b4167095d6e/kube-rbac-proxy-main/0.log" Jul 02 19:45:00.121317 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.121277 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4gmvm_c3e84b10-f7ac-4a83-8703-9b4167095d6e/kube-rbac-proxy-self/0.log" Jul 02 19:45:00.157325 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.157255 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4gmvm_c3e84b10-f7ac-4a83-8703-9b4167095d6e/openshift-state-metrics/0.log" Jul 02 19:45:00.466045 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.465941 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f9cff5d-vz27n_3922f714-c6f6-4a3c-b4cd-f4d72349ac69/telemeter-client/0.log" Jul 02 19:45:00.492993 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.492965 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f9cff5d-vz27n_3922f714-c6f6-4a3c-b4cd-f4d72349ac69/reload/0.log" Jul 02 19:45:00.513925 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.513899 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f9cff5d-vz27n_3922f714-c6f6-4a3c-b4cd-f4d72349ac69/kube-rbac-proxy/0.log" Jul 02 19:45:00.549839 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.549809 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67844cb486-wfqd2_49016bde-37e0-4215-9b2f-f558ed80cc5e/thanos-query/0.log" Jul 02 19:45:00.575840 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.575809 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67844cb486-wfqd2_49016bde-37e0-4215-9b2f-f558ed80cc5e/kube-rbac-proxy-web/0.log" Jul 02 19:45:00.637176 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.637150 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67844cb486-wfqd2_49016bde-37e0-4215-9b2f-f558ed80cc5e/kube-rbac-proxy/0.log" Jul 02 19:45:00.713453 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.713420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67844cb486-wfqd2_49016bde-37e0-4215-9b2f-f558ed80cc5e/prom-label-proxy/0.log" Jul 02 19:45:00.811554 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.811521 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67844cb486-wfqd2_49016bde-37e0-4215-9b2f-f558ed80cc5e/kube-rbac-proxy-rules/0.log" Jul 02 19:45:00.862938 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:00.862907 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67844cb486-wfqd2_49016bde-37e0-4215-9b2f-f558ed80cc5e/kube-rbac-proxy-metrics/0.log" Jul 02 19:45:01.938957 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:01.938918 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j"] Jul 02 19:45:01.945177 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:01.945154 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:01.963547 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:01.963518 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j"] Jul 02 19:45:02.030844 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.030793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-lib-modules\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.031037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.030890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-proc\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.031037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.030923 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-sys\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.031037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.030966 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfmz\" (UniqueName: \"kubernetes.io/projected/439d9c8b-b5cb-45f5-8184-1a5fe40260be-kube-api-access-gmfmz\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.031037 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.031006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-podres\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.081151 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.081121 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-lwvqs_62d98d53-aaf6-4742-8fc8-9b003ccb3ba4/networking-console-plugin/0.log" Jul 02 19:45:02.132589 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.132543 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-sys\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.132775 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.132690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-sys\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.132775 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.132723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfmz\" (UniqueName: \"kubernetes.io/projected/439d9c8b-b5cb-45f5-8184-1a5fe40260be-kube-api-access-gmfmz\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.132775 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.132766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-podres\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.132965 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.132922 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-lib-modules\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.133021 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.132972 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-podres\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.133021 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.133000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-proc\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.133108 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.133069 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-lib-modules\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.133143 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.133102 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/439d9c8b-b5cb-45f5-8184-1a5fe40260be-proc\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.141924 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.141898 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfmz\" (UniqueName: \"kubernetes.io/projected/439d9c8b-b5cb-45f5-8184-1a5fe40260be-kube-api-access-gmfmz\") pod \"perf-node-gather-daemonset-fnv4j\" (UID: \"439d9c8b-b5cb-45f5-8184-1a5fe40260be\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.258627 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.258549 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.448976 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.448838 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j"] Jul 02 19:45:02.451963 ip-10-0-137-48 kubenswrapper[2582]: W0702 19:45:02.451929 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod439d9c8b_b5cb_45f5_8184_1a5fe40260be.slice/crio-5e866920a0e9269b02ea3dc5c7df4ecd1bf16d05fd2967ee1981d778b5d968a6 WatchSource:0}: Error finding container 5e866920a0e9269b02ea3dc5c7df4ecd1bf16d05fd2967ee1981d778b5d968a6: Status 404 returned error can't find the container with id 5e866920a0e9269b02ea3dc5c7df4ecd1bf16d05fd2967ee1981d778b5d968a6 Jul 02 19:45:02.676653 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.676626 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/1.log" Jul 02 19:45:02.683608 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.683575 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-6hf54_ef933343-91a6-46b5-8d95-a7292b85d52a/console-operator/2.log" Jul 02 19:45:02.888987 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.888954 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" event={"ID":"439d9c8b-b5cb-45f5-8184-1a5fe40260be","Type":"ContainerStarted","Data":"1805bd73e83a308338cfaae741639cd4b2e96ab1c22a3b9eb1ca60c6c3e36ec6"} Jul 02 19:45:02.889168 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.889016 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" event={"ID":"439d9c8b-b5cb-45f5-8184-1a5fe40260be","Type":"ContainerStarted","Data":"5e866920a0e9269b02ea3dc5c7df4ecd1bf16d05fd2967ee1981d778b5d968a6"} Jul 02 19:45:02.889168 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.889043 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:02.904484 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:02.904426 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" podStartSLOduration=1.9044050449999999 podStartE2EDuration="1.904405045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:02.903502895 +0000 UTC m=+2495.439260396" watchObservedRunningTime="2026-07-02 19:45:02.904405045 +0000 UTC m=+2495.440162547" Jul 02 19:45:03.145448 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:03.145361 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-797f9bff7f-dw9zs_f202e23a-725f-4078-8d61-e7f1581dc859/console/0.log" Jul 02 19:45:03.184126 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:03.184097 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-lm7kx_38a1dfa4-7d13-4e36-b26a-a0aeadf70aad/download-server/0.log" Jul 02 19:45:04.837940 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:04.837911 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wtjsf_2dc2a90b-4a16-421e-a0d1-35831755f6f0/dns/0.log" Jul 02 19:45:04.861457 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:04.861434 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wtjsf_2dc2a90b-4a16-421e-a0d1-35831755f6f0/kube-rbac-proxy/0.log" Jul 02 19:45:04.933919 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:04.933888 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qchw_4f4c25bb-c741-4b4a-a5a9-202fa9a43bf5/dns-node-resolver/0.log" Jul 02 19:45:05.558681 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:05.558646 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c56c48c46-8z9wt_1a511ba6-5700-471f-a727-8f860363d650/registry/0.log" Jul 02 19:45:05.633247 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:05.633213 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvw5b_19b9b2c4-b420-4ea8-86e9-bdaa3dc5bf24/node-ca/0.log" Jul 02 19:45:06.838841 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:06.838801 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jtxlz_d05e450c-0106-4da6-a1d5-f393d2e7dc7b/payload-pre-processing/0.log" Jul 02 19:45:06.914105 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:06.914071 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66b9b55d7-skxpt_b2780353-a8e5-4cdc-92b4-5db22295bc50/router/0.log" Jul 02 19:45:07.616101 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:07.616037 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqbvc_4640ed7c-c7ad-4805-9190-332f8ff295c4/serve-healthcheck-canary/0.log" Jul 02 19:45:08.128194 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:08.128154 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72q8h_6c3a885a-57ac-481b-bde9-370000fcecad/kube-rbac-proxy/0.log" Jul 02 19:45:08.154657 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:08.154627 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72q8h_6c3a885a-57ac-481b-bde9-370000fcecad/exporter/0.log" Jul 02 19:45:08.183545 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:08.183516 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72q8h_6c3a885a-57ac-481b-bde9-370000fcecad/extractor/0.log" Jul 02 19:45:08.910201 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:08.910166 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-fnv4j" Jul 02 19:45:10.549405 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:10.549363 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vfwdc_9e201540-5523-42ce-a836-f006a099b3cf/manager/0.log" Jul 02 19:45:10.711833 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:10.711796 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4w99m_f11a1588-d9b6-4416-8f55-4755ea04f373/manager/0.log" Jul 02 19:45:11.245953 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:11.245918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-q54wr_addc6b05-edd0-4c01-9818-3403b8d5adda/manager/0.log" Jul 02 19:45:11.264519 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:11.264482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-q54wr_addc6b05-edd0-4c01-9818-3403b8d5adda/copy-manifests/0.log" Jul 02 19:45:12.044479 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:12.044445 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jtxlz_d05e450c-0106-4da6-a1d5-f393d2e7dc7b/payload-pre-processing/0.log" Jul 02 19:45:12.101659 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:12.101564 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66b9b55d7-skxpt_b2780353-a8e5-4cdc-92b4-5db22295bc50/router/0.log" Jul 02 19:45:12.551390 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:12.551362 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-744887b959-rs5lg_141dc3eb-8028-404f-9297-f5d2ac87799d/manager/0.log" Jul 02 19:45:13.392807 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:13.392745 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jtxlz_d05e450c-0106-4da6-a1d5-f393d2e7dc7b/payload-pre-processing/0.log" Jul 02 19:45:13.451526 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:13.451391 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66b9b55d7-skxpt_b2780353-a8e5-4cdc-92b4-5db22295bc50/router/0.log" Jul 02 19:45:17.788365 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:17.788338 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-b8fp4_d68bb488-2d5b-4f4e-ace4-5dfac55b2935/kube-storage-version-migrator-operator/1.log" Jul 02 19:45:17.789398 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:17.789361 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-b8fp4_d68bb488-2d5b-4f4e-ace4-5dfac55b2935/kube-storage-version-migrator-operator/0.log" Jul 02 19:45:18.803348 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:18.803318 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4mn26_35d99939-d2f7-45f7-98b0-bfbacb4e7554/kube-multus/0.log" Jul 02 19:45:19.099895 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.099864 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/kube-multus-additional-cni-plugins/0.log" Jul 02 19:45:19.123877 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.123845 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/egress-router-binary-copy/0.log" Jul 02 19:45:19.149561 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.149525 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/cni-plugins/0.log" Jul 02 19:45:19.172947 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.172919 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/bond-cni-plugin/0.log" Jul 02 19:45:19.197119 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.197071 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/routeoverride-cni/0.log" Jul 02 19:45:19.221854 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.221821 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/whereabouts-cni-bincopy/0.log" Jul 02 19:45:19.243574 ip-10-0-137-48 kubenswrapper[2582]: I0702 19:45:19.243552 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8k6v_26cd1bbc-6409-4610-81a2-d0451f36dcad/whereabouts-cni/0.log"